00000001:00080000:3.0F:1788572440.780683:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000001:00080000:3.0:1788572440.780718:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901916 is committed 00000020:00080000:3.0:1788572440.780725:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0591b1900 refcount 2 committed 0 result 0 batchid 8589934639 00000020:00080000:3.0:1788572440.780731:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c04a552800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c047048780 00000020:00080000:3.0:1788572440.780734:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c04a552600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88bf46fe1000 00000001:00080000:3.0:1788572440.780752:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000020:00080000:3.0:1788572440.780767:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934639 committed batchid 4294967527 00000020:00080000:3.0:1788572440.780957:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:1.0F:1788572440.873630:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788572441.706464:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518427520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572441.706554:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1788572441.706780:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518427776:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.706832:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572441.706882:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518428288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.706907:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572441.706934:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788572441.706940:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518427648:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.706967:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572441.706998:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518428160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.707018:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572441.707048:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518427776 00000100:00100000:2.0:1788572441.707056:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518427776 00000100:00100000:2.0:1788572441.707113:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572441.707122:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518427776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.707177:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518427776:12345-0@lo:400:kworker.0 Request processed in 57us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572441.707184:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572441.707208:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428288 00000100:00100000:2.0:1788572441.707211:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428288 00000100:00100000:2.0:1788572441.707275:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428160 00000100:00100000:2.0:1788572441.707278:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428160 00000100:00100000:2.0:1788572441.707791:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572441.707801:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518428288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.707842:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518428288:12345-0@lo:400:kworker.0 Request processed in 44us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572441.707849:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572441.707863:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572441.707868:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.707910:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518428160:12345-0@lo:400:kworker.0 Request processed in 42us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572441.707917:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788572441.707939:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572441.707944:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572441.707987:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518428160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.708001:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518427776:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.708010:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572441.708265:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518428032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572441.708307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572441.708328:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572441.708334:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518427904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572441.708356:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572441.709703:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518427648 00000100:00100000:3.0:1788572441.709720:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518427648 00000100:00100000:3.0:1788572441.709783:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788572441.709793:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3298:x1875453518427648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572441.709892:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3298:x1875453518427648:12345-0@lo:400:kworker.0 Request processed in 101us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572441.709899:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788572441.709964:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518427648:0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.710449:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428032 00000100:00100000:2.0:1788572441.710455:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428032 00000100:00100000:2.0:1788572441.710492:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788572441.710500:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518428032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572441.710545:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518428032:12345-0@lo:400:kworker.0 Request processed in 47us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572441.710551:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572441.710631:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518428032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572441.711494:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518427904 00000100:00100000:0.0:1788572441.711502:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518427904 00000100:00100000:0.0:1788572441.711558:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788572441.711566:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518427904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572441.711625:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518427904:12345-0@lo:400:kworker.0 Request processed in 60us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572441.711632:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788572441.711823:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572441.711895:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518427904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572441.713089:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518427520 00000100:00100000:1.0:1788572441.713101:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518427520 00000100:00100000:1.0:1788572441.713151:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788572441.713162:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518427520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572441.713203:0:19593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788572441.713453:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518427520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 292us (6898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572441.713460:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788572441.714157:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518427520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572441.899496:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572442.379849:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572442.380798:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495374592 00000100:00100000:2.0:1788572442.380813:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495374592 00000100:00100000:2.0:1788572442.380893:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:2.0:1788572442.380905:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:17447:x1875453495374592:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788572442.381024:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:17447:x1875453495374592:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 121us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572442.381031:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00080000:1.0:1788572442.381511:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572442.384730:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572442.384923:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495374848 00000100:00100000:3.0:1788572442.384933:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495374848 00000100:00100000:3.0:1788572442.384991:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788572442.385001:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:17447:x1875453495374848:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572442.385597:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:17447:x1875453495374848:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 595us (875us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1788572442.385606:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00010000:00010000:2.0:1788572442.923877:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572443.753735:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518428416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572443.753821:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572443.753954:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428416 00000100:00100000:3.0:1788572443.753963:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428416 00000100:00100000:3.0:1788572443.754035:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572443.754045:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518428416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572443.754090:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572443.754136:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518428416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572443.754143:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572443.754186:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518428416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572443.755094:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572443.944628:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572444.509836:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572444.509886:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572444.510003:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495374976 00000100:00100000:1.0:1788572444.510013:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495374976 00000100:00100000:1.0:1788572444.510079:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:1.0:1788572444.510091:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8c1434-73ad-4808-be79-cf461833332c+13:2355:x1875453495374976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572444.510188:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8c1434-73ad-4808-be79-cf461833332c+13:2355:x1875453495374976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572444.510195:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:0.0:1788572444.510740:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572444.510777:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572444.510813:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375104 00000100:00100000:0.0:1788572444.510833:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375104 00000100:00100000:0.0:1788572444.510872:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375488 00000100:00100000:0.0:1788572444.510875:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375488 00000100:00100000:0.0:1788572444.510891:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788572444.510897:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:2355:x1875453495375104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572444.510941:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:2355:x1875453495375104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572444.510948:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788572444.510964:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788572444.510971:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2355:x1875453495375488:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572444.510995:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2355:x1875453495375488:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572444.511000:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00080000:1.0:1788572444.511981:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572444.512334:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572444.514397:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572444.514998:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375360 00000100:00100000:2.0:1788572444.515011:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375360 00000100:00080000:0.0:1788572444.515076:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572444.515088:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375232 00000100:00100000:2.0:1788572444.515092:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375232 00000100:00100000:0.0:1788572444.515189:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1788572444.515204:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495375360:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572444.515315:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495375360:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 115us (5427us total) trans 0 rc 0/0 00000100:00080000:3.0:1788572444.515876:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572444.517509:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572444.517552:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375616 00000100:00100000:1.0:1788572444.517561:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375616 00000100:00100000:3.0:1788572444.518949:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375744 00000100:00100000:3.0:1788572444.518961:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375744 00000100:00100000:2.0:1788572444.522617:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1788572444.522706:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2352:x1875453495375232:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:2.0:1788572444.522744:0:19969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c0111a 00000100:00080000:2.0:1788572444.522769:0:19969:0:(import.c:65:import_set_state_nolock()) ffff88c074c4e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572444.522820:0:19969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901889 00000100:00100000:2.0:1788572444.524832:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+2:2352:x1875453495375232:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 2189us (12493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572444.524848:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:2.0:1788572444.525029:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572444.525797:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572444.525804:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572444.529837:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1788572444.529892:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572444.529910:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2352:x1875453495375616:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:0.0:1788572444.529950:0:19590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c01152 00000100:00080000:0.0:1788572444.529960:0:19590:0:(import.c:65:import_set_state_nolock()) ffff88c052a59000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788572444.529995:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788572444.530012:0:19590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901889 00000100:00100000:0.0:1788572444.531469:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+2:2352:x1875453495375616:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 1557us (17353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572444.531648:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572444.533862:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788572444.533884:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2352:x1875453495375744:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:3.0:1788572444.533919:0:19591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c01159 00000100:00080000:3.0:1788572444.533939:0:19591:0:(import.c:65:import_set_state_nolock()) ffff88c052a5a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572444.534042:0:19591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901901 00000100:00100000:3.0:1788572444.534809:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc253da9-16dc-43a2-a270-63fc175cf1ea+2:2352:x1875453495375744:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 929us (17305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572444.534822:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00010000:00010000:1.0:1788572444.539720:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572444.968524:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788572445.890893:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901919 is committed 00000020:00080000:3.0:1788572445.890916:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934639 batchid updated 00000020:00080000:1.0:1788572445.890968:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934639 00000020:00080000:1.0:1788572445.890981:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934639 00010000:00010000:3.0:1788572445.995653:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572446.406414:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc253da9-16dc-43a2-a270-63fc175cf1ea 00000020:00000080:3.0:1788572446.406427:0:7635:0:(genops.c:885:class_export_put()) final put ffff88c052a5c000/fc253da9-16dc-43a2-a270-63fc175cf1ea 00000020:00000080:0.0:1788572446.406769:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c052a5c000/fc253da9-16dc-43a2-a270-63fc175cf1ea for lustre-OST0001 00000020:00000080:0.0:1788572446.406827:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c052a5a000 for lustre-OST0001 00000001:00100000:3.0:1788572446.407679:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc253da9-16dc-43a2-a270-63fc175cf1ea 00000020:00000080:3.0:1788572446.407685:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c052a5e000/fc253da9-16dc-43a2-a270-63fc175cf1ea 00000001:00100000:3.0:1788572446.407703:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:3.0:1788572446.407705:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c074c4c000/2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:3.0:1788572446.407718:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c052a5e000/fc253da9-16dc-43a2-a270-63fc175cf1ea for lustre-OST0000 00000020:00000080:3.0:1788572446.407756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074c4c000/2e29ee59-1edd-4938-bd41-1bf1d77c561a for lustre-OST0000 00000020:00000080:3.0:1788572446.407769:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c052a59000 for lustre-OST0000 00000020:00000080:3.0:1788572446.407773:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c074c4e000 for lustre-OST0000 00000100:00100000:3.0:1788572446.826622:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572446.826650:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518428544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572446.826722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.826792:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428544 00000100:00100000:3.0:1788572446.826799:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428544 00000100:00100000:3.0:1788572446.826858:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572446.826870:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518428544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572446.826911:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788572446.826957:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518428544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.826964:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788572446.826984:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572446.827019:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518428544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572446.829406:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518429056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.829482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.829525:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572446.829531:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518428928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.829552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.829581:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429056 00000100:00100000:1.0:1788572446.829587:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429056 00000100:00100000:1.0:1788572446.829632:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428928 00000100:00100000:1.0:1788572446.829635:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428928 00000100:00100000:1.0:1788572446.829651:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572446.829898:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518429056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.829953:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518429056:12345-0@lo:400:kworker.0 Request processed in 294us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.829960:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572446.829978:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572446.829984:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518428928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.830011:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518428928:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.830018:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572446.830060:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518428928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.830071:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518429056:0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.830087:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518428800:0@lo:400:kworker.0 00000100:00080000:1.0:1788572446.830091:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572446.830119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.830147:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572446.830153:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518428672:0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.830182:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.830208:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518429184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.830231:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.830289:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428672 00000100:00100000:3.0:1788572446.830293:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428672 00000100:00100000:3.0:1788572446.830327:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788572446.830341:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3298:x1875453518428672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.830376:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3298:x1875453518428672:12345-0@lo:400:kworker.0 Request processed in 35us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.830382:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788572446.830407:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429184 00000100:00100000:3.0:1788572446.830411:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429184 00000100:00100000:3.0:1788572446.830437:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572446.830443:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518429184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.830469:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518429184:12345-0@lo:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.830475:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572446.830500:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518428672:0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.830518:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518429184:0@lo:400:kworker.0 00000100:00080000:3.0:1788572446.830536:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572446.830609:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518428800 00000100:00100000:1.0:1788572446.830613:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518428800 00000100:00100000:1.0:1788572446.830643:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788572446.830649:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.830695:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518428800:12345-0@lo:400:kworker.0 Request processed in 45us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.830708:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788572446.831204:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518428800:0@lo:400:kworker.0 00000100:00080000:3.0:1788572446.831223:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572447.019062:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572448.040764:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572448.872771:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572448.872799:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518429312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572448.872885:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572448.873000:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429312 00000100:00100000:1.0:1788572448.873011:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429312 00000100:00100000:1.0:1788572448.873087:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788572448.873098:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518429312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572448.873140:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572448.873193:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518429312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572448.873201:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788572448.873287:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518429312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572448.873487:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572449.070566:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572449.621034:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572449.621077:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572449.621160:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572449.621191:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572449.621218:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495375872 00000100:00100000:3.0:1788572449.621227:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495375872 00000100:00100000:3.0:1788572449.621325:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:3.0:1788572449.621336:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8c1434-73ad-4808-be79-cf461833332c+13:2353:x1875453495375872:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572449.621408:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8c1434-73ad-4808-be79-cf461833332c+13:2353:x1875453495375872:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572449.621427:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:3.0:1788572449.621462:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376128 00000100:00100000:3.0:1788572449.621466:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376128 00000100:00100000:3.0:1788572449.621504:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1788572449.621511:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2353:x1875453495376128:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572449.621553:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2353:x1875453495376128:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572449.621560:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788572449.635802:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376000 00000100:00100000:0.0:1788572449.635821:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376000 00000100:00100000:0.0:1788572449.635879:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376256 00000100:00100000:0.0:1788572449.635882:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376256 00000100:00100000:0.0:1788572449.635910:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788572449.635921:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:2353:x1875453495376000:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572449.636015:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:2353:x1875453495376000:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 95us (14992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572449.636023:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788572449.636043:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:0.0:1788572449.636050:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2353:x1875453495376256:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572449.636074:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2353:x1875453495376256:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (14997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572449.636080:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00080000:0.0:1788572449.636098:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572449.636102:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788572449.770819:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788572449.770830:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572449.770918:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788572449.770924:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788572450.089445:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.113375:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572451.945531:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518429568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.945643:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3299:1875453518429440:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.945733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.945787:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518429952:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.945831:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.945872:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518429824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.945896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.945916:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572451.945922:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518429696:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.945944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.945971:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429440 00000100:00100000:3.0:1788572451.945978:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429440 00000100:00100000:3.0:1788572451.946025:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788572451.946034:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3299:x1875453518429440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.946081:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3299:x1875453518429440:12345-0@lo:400:kworker.0 Request processed in 48us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.946088:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788572451.946128:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429952 00000100:00100000:3.0:1788572451.946133:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429952 00000100:00100000:0.0:1788572451.946164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.946164:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429824 00000100:00100000:3.0:1788572451.946167:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429824 00000100:00100000:3.0:1788572451.946180:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788572451.946184:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518430080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.946186:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518429952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572451.946209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.946214:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518429952:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.946220:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572451.946229:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518430080 00000100:00100000:3.0:1788572451.946232:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518430080 00000100:00100000:0.0:1788572451.946234:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429696 00000100:00100000:0.0:1788572451.946238:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429696 00000100:00100000:3.0:1788572451.946270:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572451.946276:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518429824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572451.946300:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518429568 00000100:00100000:0.0:1788572451.946303:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518429568 00000100:00100000:3.0:1788572451.946318:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518429824:12345-0@lo:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572451.946324:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572451.946324:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788572451.946330:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572451.946360:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518429696:12345-0@lo:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572451.946366:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572451.946380:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788572451.946386:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518429568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572451.946418:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518429568:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572451.946423:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788572451.946465:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518429568:0@lo:400:kworker.0 00000100:00080000:0.0:1788572451.946523:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572451.946528:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572451.946530:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572451.946849:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572451.946860:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518430080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.946901:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518430080:12345-0@lo:400:kworker.0 Request processed in 44us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.946907:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572451.946936:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572451.946965:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.946995:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518430208 00000100:00100000:2.0:1788572451.946999:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518430208 00000100:00100000:2.0:1788572451.947025:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788572451.947032:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518430208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572451.947059:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788572451.947093:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518430208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.947100:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572451.947575:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3299:1875453518429440:0@lo:400:kworker.0 00000100:00100000:0.0:1788572451.947606:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518429952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.947827:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572451.947873:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518430080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.947941:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518429696:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.947954:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518429824:0@lo:400:kworker.0 00010000:00010000:2.0:1788572452.136416:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572453.160582:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572453.996052:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572453.996076:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518430336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572453.996178:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572453.996245:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518430336 00000100:00100000:3.0:1788572453.996273:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518430336 00000100:00100000:3.0:1788572453.996354:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572453.996365:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518430336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572453.996400:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572453.996445:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518430336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572453.996463:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788572453.996485:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572453.996522:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518430336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572454.189862:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572454.654666:0:21744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1e: Test RW-PCC with non-root user ==== 21:40:52 (1788572452) 00000100:00100000:1.0:1788572454.760209:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572454.760278:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572454.760322:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572454.760350:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572454.760375:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376512 00000100:00100000:1.0:1788572454.760385:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376512 00000100:00100000:1.0:1788572454.760442:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376768 00000100:00100000:1.0:1788572454.760445:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376768 00000100:00100000:1.0:1788572454.760463:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1788572454.760472:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:2355:x1875453495376512:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572454.760553:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:2355:x1875453495376512:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572454.760561:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1788572454.760582:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:1.0:1788572454.760589:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2355:x1875453495376768:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572454.760632:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2355:x1875453495376768:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572454.760639:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00080000:1.0:1788572454.760662:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572454.760852:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376640 00000100:00100000:2.0:1788572454.760857:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376640 00000100:00100000:2.0:1788572454.760906:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788572454.760914:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495376640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572454.760949:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495376640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 37us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572454.760956:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788572454.761162:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495376384 00000100:00100000:3.0:1788572454.761167:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495376384 00000100:00100000:3.0:1788572454.761239:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:3.0:1788572454.761275:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8c1434-73ad-4808-be79-cf461833332c+13:2355:x1875453495376384:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572454.761316:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8c1434-73ad-4808-be79-cf461833332c+13:2355:x1875453495376384:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 70us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572454.761324:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00080000:1.0:1788572454.761473:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572454.977704:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572454.977796:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377024 00000100:00100000:2.0:1788572454.977808:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377024 00000100:00100000:2.0:1788572454.977899:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1788572454.977911:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+12:18308:x1875453495377024:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572454.977952:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572454.977974:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0142a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11559 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978049:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978063:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978077:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978140:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978148:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978155:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978560:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0143f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978571:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0143f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978578:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0143f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572454.978589:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788572454.978728:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978736:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978742:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978747:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572454.978752:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978760:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978772:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:2.0:1788572454.978775:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572454.978780:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978786:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01431 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978797:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978802:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978806:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978820:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572454.978824:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978867:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978877:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88c0593ef300) 00010000:00010000:2.0:1788572454.978880:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572454.978883:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.978890:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01438 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.979387:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0142a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11559 expref: 15 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.979403:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0143f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11559 expref: 14 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.979411:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:2.0:1788572454.979414:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572454.979416:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572454.979483:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+14:18308:x1875453495377024:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1575us (1790us total) trans 12884901920 rc 0/0 00000100:00100000:2.0:1788572454.979492:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788572454.986063:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572454.986239:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572454.986437:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377152 00000100:00100000:2.0:1788572454.986459:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377152 00000100:00100000:2.0:1788572454.986524:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:2.0:1788572454.986535:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+14:2355:x1875453495377152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572454.986560:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572454.986585:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0143f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11559 expref: 14 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572454.986605:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:2.0:1788572454.986610:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572454.986662:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:2355:x1875453495377152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 129us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572454.986670:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788572454.987873:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377280 00000100:00100000:3.0:1788572454.987883:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377280 00000100:00100000:3.0:1788572454.987984:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:3.0:1788572454.987994:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:18308:x1875453495377280:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788572454.988100:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:18308:x1875453495377280:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 107us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572454.988107:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788572455.156886:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572455.156997:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377408 00000100:00100000:2.0:1788572455.157008:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377408 00000100:00100000:2.0:1788572455.157069:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1788572455.157081:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:18318:x1875453495377408:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572455.157104:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572455.157126:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0144d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11560 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157191:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157206:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157218:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157299:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157341:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157348:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157670:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157679:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157686:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157692:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572455.157697:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157705:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157719:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572455.157722:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572455.157727:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157734:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157753:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157759:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157765:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157769:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572455.157772:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157777:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157784:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe06b53f9 (ffff88c0593ef300) 00010000:00010000:2.0:1788572455.157787:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572455.157790:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157794:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c0145b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157829:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0144d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11560 expref: 14 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157839:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572455.157841:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572455.157851:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0144d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11560 expref: 14 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.157860:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572455.157921:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:18318:x1875453495377408:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 842us (1045us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572455.157929:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1788572455.165384:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.165507:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377664 00000100:00100000:3.0:1788572455.165519:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377664 00000100:00100000:3.0:1788572455.165581:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:3.0:1788572455.165592:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:18318:x1875453495377664:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:3.0:1788572455.165647:0:18901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572455.165675:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01216 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114bf expref: 13 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.165715:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:3.0:1788572455.165722:0:18901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572455.165942:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.165957:0:18901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 5 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.165966:0:18901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.166000:0:18901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 5 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.166016:0:18901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 5 pid: 18902 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572455.166031:0:18901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518430464:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572455.166130:0:18901:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050694d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572455.170613:0:18901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518430464:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572455.170644:0:18901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572455.172402:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572455.173674:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377792 00000100:00100000:2.0:1788572455.173688:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377792 00010000:00010000:2.0:1788572455.173736:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 6 pid: 18902 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572455.173828:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788572455.173839:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4665e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2356:x1875453495377792:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572455.173857:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572455.173865:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 6 pid: 18902 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.173879:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 6 pid: 18902 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.173901:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969c01224 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114c6 expref: 6 pid: 18902 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.173919:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572455.173925:0:18886:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.173949:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.173956:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.173995:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572455.174071:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4665e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2356:x1875453495377792:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 234us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572455.174078:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00010000:00010000:1.0:1788572455.174394:0:18901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.174403:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.174426:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.174436:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.174445:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.176620:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00010000:00010000:1.0:1788572455.176643:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.176653:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.177106:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.177112:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.177116:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.177124:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.177141:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:1.0:1788572455.177144:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.177149:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.177462:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01462 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572455.177489:0:18901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000598c7cd reply state 0000000068a0e6a0 transno 12884901921 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572455.177498:0:18901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572455.177621:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+14:18318:x1875453495377664:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 12027us (12242us total) trans 12884901921 rc 0/0 00000100:00100000:1.0:1788572455.177629:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00010000:00010000:3.0:1788572455.182573:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.182591:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.182611:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.182617:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572455.182622:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.182630:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.182647:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe06b53f9 (ffff88c058eaca00) 00010000:00010000:3.0:1788572455.182650:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572455.182666:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.182673:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01469 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572455.194623:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.194776:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495377920 00000100:00100000:1.0:1788572455.194787:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495377920 00000100:00100000:1.0:1788572455.194851:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:1.0:1788572455.194862:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+13:18319:x1875453495377920:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:1.0:1788572455.194903:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.194925:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c01470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11567 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.194986:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c01477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.195000:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c01477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.195011:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c01477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.195043:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788572455.195046:0:18900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572455.195079:0:18900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c01477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.195102:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c01470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11567 expref: 15 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.195119:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c01477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11567 expref: 14 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.195128:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:1.0:1788572455.195131:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572455.195135:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995600, rc 0) 00000100:00100000:1.0:1788572455.195192:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+14:18319:x1875453495377920:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 332us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.195207:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1788572455.198689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.200589:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495378048 00000100:00100000:1.0:1788572455.200604:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495378048 00000100:00100000:1.0:1788572455.200672:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1788572455.200683:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+14:18319:x1875453495378048:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:1.0:1788572455.200707:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.200729:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0147e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1156e expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200794:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200807:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200818:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200833:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200840:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200848:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200950:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01493 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200977:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01493 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.200985:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01493 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.201016:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00000004:00200000:1.0:1788572455.201020:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572455.201037:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01493 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201049:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201056:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201062:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201067:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.201071:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201077:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201089:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:1.0:1788572455.201091:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.201103:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201120:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201134:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201139:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201145:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201150:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.201153:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201159:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201167:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe06b53f9 (ffff88c058eacd00) 00010000:00010000:1.0:1788572455.201170:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.201172:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201178:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0148c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201217:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0147e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1156e expref: 16 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201243:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01493 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1156e expref: 15 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.201289:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572455.201291:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572455.201294:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994c00, rc 0) 00000100:00100000:1.0:1788572455.201371:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+15:18319:x1875453495378048:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 689us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.201378:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1788572455.206614:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.207240:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495378304 00000100:00100000:1.0:1788572455.207278:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495378304 00000100:00100000:1.0:1788572455.207347:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1788572455.207357:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+15:18319:x1875453495378304:12345-192.168.202.2@tcp:36:chmod.0 00010000:00010000:1.0:1788572455.207407:0:18900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572455.207434:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01493 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1156e expref: 15 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.207451:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572455.207461:0:18900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572455.207484:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.207496:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.207506:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572455.207777:0:18900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cfdc9b5 reply state 0000000048c1b356 transno 12884901922 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572455.207788:0:18900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788572455.207796:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00000100:00100000:1.0:1788572455.207874:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18319:x1875453495378304:12345-192.168.202.2@tcp:36:chmod.0 Request processed in 518us (1270us total) trans 12884901922 rc 0/0 00000100:00100000:1.0:1788572455.207881:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00010000:00010000:3.0:1788572455.212320:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572455.216178:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.216197:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.216204:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.216221:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572455.216226:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.216233:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.216272:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eacd00) 00010000:00010000:2.0:1788572455.216275:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572455.216280:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.216303:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c0149a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572455.275387:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.282604:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495378432 00000100:00100000:1.0:1788572455.282619:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495378432 00000100:00100000:1.0:1788572455.282695:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:1.0:1788572455.282706:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+15:18325:x1875453495378432:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:1.0:1788572455.282733:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.282754:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c014a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11575 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572455.286419:0:18901:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3613us 00010000:00010000:1.0:1788572455.312585:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312606:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312614:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312625:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312641:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312646:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312796:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c014b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312801:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c014b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312805:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c014b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.312822:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00000004:00200000:1.0:1788572455.312825:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572455.312854:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c014b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312865:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312870:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312875:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312879:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.312882:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312893:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312904:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:1.0:1788572455.312906:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.312910:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312915:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312923:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312928:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312934:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312939:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.312941:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312947:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312953:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe06b53f9 (ffff88c058eacb00) 00010000:00010000:1.0:1788572455.312956:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.312959:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.312974:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.313009:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c014a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11575 expref: 17 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.313020:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c014b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11575 expref: 16 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.313025:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572455.313027:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788572455.313029:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995400, rc 0) 00000100:00100000:1.0:1788572455.313103:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18325:x1875453495378432:12345-192.168.202.2@tcp:101:dd.500 Request processed in 30398us (37725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.313109:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1788572455.320834:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572455.320941:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495378688 00000100:00100000:2.0:1788572455.320952:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495378688 00000100:00100000:2.0:1788572455.321012:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1788572455.321023:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18325:x1875453495378688:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:2.0:1788572455.321043:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572455.321064:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c014bd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1157c expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.321207:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.321223:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.321235:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.321329:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.321337:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.321345:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572455.321959:0:18902:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =59 00000004:00080000:2.0:1788572455.321975:0:18902:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+59 in llog 00000004:00080000:2.0:1788572455.322025:0:18902:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788572455.322195:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322206:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322215:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322277:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322284:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322292:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322299:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572455.322304:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322325:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322339:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:2.0:1788572455.322342:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572455.322348:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322354:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c014c4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572455.322376:0:18902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003778b905 reply state 00000000f6afda7d transno 12884901923 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572455.322386:0:18902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572455.322420:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c014bd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 19 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322435:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.322443:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:2.0:1788572455.322446:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572455.322448:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:2.0:1788572455.322526:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:18325:x1875453495378688:12345-192.168.202.2@tcp:101:dd.500 Request processed in 1505us (1703us total) trans 12884901923 rc 0/0 00000100:00100000:2.0:1788572455.322535:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00010000:00010000:2.0:1788572455.325015:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.325034:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.325041:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.325047:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572455.325052:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.325078:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.325099:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c0593ef300) 00010000:00010000:2.0:1788572455.325102:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572455.325107:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.325114:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c014cb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572455.328756:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.329348:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495378816 00000100:00100000:3.0:1788572455.329505:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495378816 00000100:00100000:3.0:1788572455.329612:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788572455.329622:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875453495378816:12345-192.168.202.2@tcp:8:dd.500 00010000:00080000:3.0:1788572455.329655:0:19969:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:3.0:1788572455.329697:0:19969:0:(genops.c:1385:class_connect()) connect: client 2e29ee59-1edd-4938-bd41-1bf1d77c561a, cookie 0x977d9e7969c014e0 00002000:00100000:3.0:1788572455.329709:0:19969:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e29ee59-1edd-4938-bd41-1bf1d77c561a/ffff88c07bd4a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788572455.329731:0:19969:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788572455.329972:0:19969:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788572455.330007:0:19969:0:(import.c:65:import_set_state_nolock()) ffff88c07bd49800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572455.330148:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2352:x1875453495378816:12345-192.168.202.2@tcp:8:dd.500 Request processed in 525us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.330156:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788572455.332804:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572455.333008:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495378944 00000100:00100000:2.0:1788572455.333020:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495378944 00000100:00100000:2.0:1788572455.333120:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788572455.333133:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:18325:x1875453495378944:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:2.0:1788572455.333153:0:19590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572455.333176:0:19590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11583 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572455.333218:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788572455.333269:0:19590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572455.333296:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788572455.333301:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572455.333321:0:19590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.333342:0:19590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.333379:0:19590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572455.333439:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:18325:x1875453495378944:12345-192.168.202.2@tcp:101:dd.500 Request processed in 309us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572455.333447:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1788572455.336167:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.336285:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495379200 00000100:00100000:3.0:1788572455.336296:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495379200 00000100:00100000:3.0:1788572455.336375:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788572455.336386:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18325:x1875453495379200:12345-192.168.202.2@tcp:35:dd.500 00000100:00100000:3.0:1788572455.336733:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:18325:x1875453495379200:12345-192.168.202.2@tcp:35:dd.500 Request processed in 348us (575us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1788572455.336741:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788572455.454521:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.454621:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495379328 00000100:00100000:1.0:1788572455.454631:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495379328 00000100:00100000:1.0:1788572455.454696:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1788572455.454708:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:18331:x1875453495379328:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:1.0:1788572455.454734:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.454754:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1158a expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.454826:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014f5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.454863:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.454876:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.454917:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00000004:00200000:1.0:1788572455.454921:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572455.454958:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.454985:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c014ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1158a expref: 21 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.455003:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1158a expref: 20 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.455013:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572455.455016:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572455.455019:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572455.455083:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:18331:x1875453495379328:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 377us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.455089:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:0.0:1788572455.473414:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.473521:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495379584 00000100:00100000:3.0:1788572455.473534:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495379584 00000100:00100000:3.0:1788572455.473602:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:3.0:1788572455.473613:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:18331:x1875453495379584:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:3.0:1788572455.473637:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572455.473659:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c014fc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11591 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.473767:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01503 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.473782:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01503 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.473794:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01503 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572455.473824:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788572455.473962:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c014fc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11591 expref: 23 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.473981:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01503 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11591 expref: 22 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.473989:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:3.0:1788572455.473992:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572455.473995:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c918800, rc 0) 00000100:00100000:3.0:1788572455.474064:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18331:x1875453495379584:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 452us (659us total) trans 12884901925 rc 0/0 00000100:00100000:3.0:1788572455.474071:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:0.0:1788572455.478937:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.479063:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495379840 00000100:00100000:1.0:1788572455.479073:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495379840 00000100:00100000:1.0:1788572455.479137:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:1.0:1788572455.479153:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18331:x1875453495379840:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:1.0:1788572455.479178:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.479211:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01511 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11598 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.479339:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01518 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.479362:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01518 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.479375:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01518 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.479387:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1788572455.479506:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01511 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11598 expref: 25 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.479526:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01518 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11598 expref: 24 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.479547:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:1.0:1788572455.479550:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788572455.479554:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994600, rc 0) 00000100:00100000:1.0:1788572455.479613:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+24:18331:x1875453495379840:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 461us (684us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1788572455.479620:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:0.0:1788572455.489432:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.493456:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495379968 00000100:00100000:1.0:1788572455.493474:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495379968 00000100:00100000:1.0:1788572455.493573:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788572455.493584:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+24:2355:x1875453495379968:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572455.493620:0:18887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572455.493648:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01503 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11591 expref: 24 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.493670:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:1.0:1788572455.493675:0:18887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572455.493742:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:2355:x1875453495379968:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 160us (4322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.493749:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788572455.511484:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.511520:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495380096 00000100:00100000:3.0:1788572455.511533:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495380096 00000100:00100000:3.0:1788572455.511596:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572455.511607:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495380096:12345-192.168.202.2@tcp:1:lfs.500 00010000:00010000:3.0:1788572455.511652:0:19969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.511672:0:19969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.511681:0:19969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572455.511685:0:19969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572455.511691:0:19969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.511747:0:19969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.511760:0:19969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 7 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572455.511776:0:19969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19969:1875453518430592:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572455.511889:0:19969:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050694d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572455.516769:0:19969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19969:1875453518430592:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572455.516806:0:19969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572455.522839:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572455.523158:0:19596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495380224 00000100:00100000:0.0:1788572455.523177:0:19596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495380224 00002000:00100000:0.0:1788572455.523238:0:19596:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x42:0x0] (0->1023) req@ffff88c07fd10a80 x1875453495380224/t0(0) o4->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:116/0 lens 1512/0 e 0 to 0 dl 1788572466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788572455.523408:0:19596:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07fd10a80 with x1875453495380224 ext(0->1023) 00010000:00010000:0.0:1788572455.523419:0:19596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 8 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.523438:0:19596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 8 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572455.523447:0:19596:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88c07fd10a80 00000100:00100000:0.0:1788572455.523552:0:19596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788572455.523564:0:19596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2355:x1875453495380224:12345-192.168.202.2@tcp:4:lfs.0 00000001:00100000:1.0:1788572455.593060:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000100:00100000:0.0:1788572455.594139:0:19596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2355:x1875453495380224:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 70569us (71303us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788572455.594174:0:19596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:0.0:1788572455.594188:0:19596:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x42:0x0] (0->1023) req@ffff88c07fd10a80 x1875453495380224/t12884901890(0) o4->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:116/0 lens 1512/448 e 0 to 0 dl 1788572466 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788572455.594197:0:19596:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07fd10a80 with x1875453495380224 ext(0->1023) 00010000:00010000:0.0:1788572455.594208:0:19596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 9 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.594226:0:19596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 9 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572455.594232:0:19596:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88c07fd10a80 00000100:00100000:0.0:1788572455.599342:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572455.599600:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495380352 00000100:00100000:2.0:1788572455.599609:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495380352 00010000:00010000:2.0:1788572455.599646:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 9 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572455.599816:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788572455.599826:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2356:x1875453495380352:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572455.599841:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788572455.599862:0:18886:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1788572455.599865:0:18886:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788572455 00002000:00010000:2.0:1788572455.599868:0:18886:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788572455 00002000:00010000:2.0:1788572455.599870:0:18886:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788572455 00010000:00010000:2.0:1788572455.599877:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 9 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.599890:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 9 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.599914:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec90955/0x977d9e7969c014e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11583 expref: 9 pid: 19590 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.599957:0:18886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572455.599962:0:18886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572455.599969:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.599980:0:18886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.600018:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572455.600081:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2356:x1875453495380352:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 255us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572455.600090:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00010000:00010000:3.0:1788572455.600155:0:19969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600173:0:19969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600200:0:19969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600208:0:19969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600228:0:19969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600236:0:19969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572455.600241:0:19969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600278:0:19969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600290:0:19969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.600299:0:19969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01526 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572455.600873:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495380096:12345-192.168.202.2@tcp:1:lfs.500 Request processed in 89264us (89397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.600883:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1788572455.607620:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.607686:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495380608 00000100:00100000:3.0:1788572455.607696:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495380608 00000100:00100000:3.0:1788572455.607759:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788572455.607770:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18331:x1875453495380608:12345-192.168.202.2@tcp:35:lfs.500 00000004:00010000:3.0:1788572455.607832:0:18903:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000013a1:0x5:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01518 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11598 expref: 23 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572455.608079:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1788572455.608110:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000001:00080000:3.0:1788572455.608822:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901929 00010000:00010000:3.0:1788572455.608870:0:18903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.608883:0:18903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 27 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.608889:0:18903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.608916:0:18903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 27 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.608926:0:18903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 27 pid: 18902 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572455.608936:0:18903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:18903:1875453518430720:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572455.610496:0:18903:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c373600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572455.624977:0:18903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:18903:1875453518430720:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572455.625024:0:18903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572455.625619:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572455.625718:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495380736 00000100:00100000:2.0:1788572455.625726:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495380736 00010000:00010000:2.0:1788572455.625765:0:18885:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 28 pid: 18902 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572455.625857:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788572455.625868:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:2355:x1875453495380736:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572455.625884:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572455.625890:0:18885:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 28 pid: 18902 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.625902:0:18885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 28 pid: 18902 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.625942:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c014d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1157c expref: 28 pid: 18902 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.625958:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:2.0:1788572455.625962:0:18885:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.625972:0:18885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.625980:0:18885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.626010:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572455.626072:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:2355:x1875453495380736:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 205us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572455.626079:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00010000:00010000:3.0:1788572455.626135:0:18903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572455.626143:0:18903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572455.626326:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901930 00000001:00080000:3.0:1788572455.626549:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901931 00000100:00100000:3.0:1788572455.626647:0:18903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18903:1875453518430848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788572455.626748:0:18903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572455.626776:0:18903:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c373c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572455.626844:0:18905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518430848 00000100:00100000:0.0:1788572455.626849:0:18905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518430848 00000100:00100000:0.0:1788572455.626902:0:18905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572455.626910:0:18905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18903:x1875453518430848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788572455.626981:0:18905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18903:x1875453518430848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572455.626988:0:18905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572455.627120:0:18903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fbdf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18903:1875453518430848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788572455.627743:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901932 00000100:00100000:0.0:1788572455.627806:0:18903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07bfb2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18903:1875453518430976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788572455.627862:0:18903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572455.627884:0:18903:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572455.627901:0:18905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518430976 00000100:00100000:0.0:1788572455.627906:0:18905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518430976 00000100:00100000:0.0:1788572455.627935:0:18905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572455.627942:0:18905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18903:x1875453518430976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788572455.628082:0:18905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18903:x1875453518430976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 140us (219us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788572455.628089:0:18905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572455.628127:0:18903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07bfb2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18903:1875453518430976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788572455.628169:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901933 00010000:00010000:0.0:1788572455.628200:0:18903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.628210:0:18903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.628218:0:18903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.628224:0:18903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572455.628228:0:18903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.628237:0:18903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.628271:0:18903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:0.0:1788572455.628275:0:18903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788572455.628286:0:18903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572455.628293:0:18903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0152d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572455.628586:0:18903:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788572455.628768:0:18903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 64 off8320 00000004:00080000:0.0:1788572455.628779:0:18903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676419530094ns, next at 677419527647ns, rc = 0 00000001:00080000:0.0:1788572455.628786:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901934 00010000:00010000:0.0:1788572455.628815:0:18903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef900) 00010000:00010000:0.0:1788572455.628818:0:18903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788572455.628826:0:18903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01518 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11598 expref: 31 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572455.628926:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18331:x1875453495380608:12345-192.168.202.2@tcp:35:lfs.500 Request processed in 21158us (21314us total) trans 12884901935 rc 0/0 00000100:00100000:0.0:1788572455.628935:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000020:00080000:0.0:1788572455.628938:0:18903:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788572455.629616:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572455.636021:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.636106:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495380864 00000100:00100000:1.0:1788572455.636119:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495380864 00000100:00100000:1.0:1788572455.636194:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:1.0:1788572455.636205:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18331:x1875453495380864:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572455.636229:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.636283:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01534 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1159f expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.636373:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01534 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1159f expref: 31 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.636390:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01534 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1159f expref: 31 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.636410:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572455.636427:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572455.636431:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994c00, rc 0) 00000100:00100000:1.0:1788572455.636485:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18331:x1875453495380864:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 282us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.636491:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788572455.645978:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.646090:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495381120 00000100:00100000:1.0:1788572455.646101:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495381120 00000100:00100000:1.0:1788572455.646168:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572455.646178:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07d673450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18331:x1875453495381120:12345-192.168.202.2@tcp:35:lfs.500 00000100:00100000:1.0:1788572455.646495:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07d673450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18331:x1875453495381120:12345-192.168.202.2@tcp:35:lfs.500 Request processed in 316us (526us total) trans 12884901936 rc 0/0 00000100:00100000:1.0:1788572455.646504:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1788572455.777340:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572455.777432:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495381376 00000100:00100000:3.0:1788572455.777443:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495381376 00000100:00100000:2.0:1788572455.777843:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788572455.777855:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18341:x1875453495381376:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572455.777880:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572455.777902:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0153b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115a6 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572455.777997:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00010000:00010000:2.0:1788572455.778118:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0153b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115a6 expref: 34 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.778166:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:2.0:1788572455.778169:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572455.778175:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0153b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115a6 expref: 34 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572455.778189:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572455.778298:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18341:x1875453495381376:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 445us (970us total) trans 12884901937 rc 301/301 00000100:00100000:2.0:1788572455.778305:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788572455.784036:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.784574:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495381504 00000100:00100000:1.0:1788572455.784585:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495381504 00000100:00100000:1.0:1788572455.784648:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:1.0:1788572455.784660:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18341:x1875453495381504:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1788572455.784746:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784765:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784779:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784795:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784802:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784825:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784923:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784931:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784938:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572455.784979:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784991:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.784998:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785005:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785010:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.785015:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785023:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785035:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572455.785043:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.785048:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785056:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c01549 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785068:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785073:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785080:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785085:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.785088:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785094:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785101:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058eacc00) 00010000:00010000:1.0:1788572455.785104:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.785107:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785113:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01550 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785127:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785150:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785157:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785162:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.785166:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785172:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785180:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572455.785183:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.785186:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.785192:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01557 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572455.785329:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18341:x1875453495381504:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 670us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.785338:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1788572455.802118:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.802232:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495381760 00000100:00100000:1.0:1788572455.802242:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495381760 00000100:00100000:1.0:1788572455.802342:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788572455.802363:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18341:x1875453495381760:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572455.802845:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18341:x1875453495381760:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 490us (733us total) trans 12884901938 rc 0/0 00000100:00100000:1.0:1788572455.802865:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000040:00080000:1.0:1788572455.912596:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788572455.912606:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572455.912646:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788572455.912653:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788572455.927326:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572455.927491:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495382016 00000100:00100000:1.0:1788572455.927503:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495382016 00000100:00100000:1.0:1788572455.927632:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:1.0:1788572455.927644:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18347:x1875453495382016:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:1.0:1788572455.927668:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.927689:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c0155e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115ad expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.927764:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.927779:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.927792:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.927805:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.927812:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.927819:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928201:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01573 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928211:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01573 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928219:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01573 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.928229:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1788572455.928362:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928370:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928376:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928382:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.928385:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928393:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928406:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572455.928409:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.928414:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928430:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01565 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928447:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928453:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928459:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928464:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572455.928467:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928472:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928480:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058eacc00) 00010000:00010000:1.0:1788572455.928483:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572455.928486:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928492:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0156c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928612:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c0155e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115ad expref: 37 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928638:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01573 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115ad expref: 36 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.928645:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572455.928648:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572455.928650:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:1.0:1788572455.928773:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18347:x1875453495382016:12345-192.168.202.2@tcp:101:dd.500 Request processed in 1131us (1464us total) trans 12884901939 rc 0/0 00000100:00100000:1.0:1788572455.928781:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:2.0:1788572455.942353:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572455.942532:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495382272 00000100:00100000:0.0:1788572455.942543:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495382272 00000100:00100000:0.0:1788572455.942615:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788572455.942631:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18347:x1875453495382272:12345-192.168.202.2@tcp:35:dd.500 00000100:00100000:0.0:1788572455.942901:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18347:x1875453495382272:12345-192.168.202.2@tcp:35:dd.500 Request processed in 272us (557us total) trans 12884901940 rc 0/0 00000100:00100000:0.0:1788572455.942933:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788572456.025822:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572456.025931:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495382528 00000100:00100000:2.0:1788572456.025943:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495382528 00000100:00100000:2.0:1788572456.026032:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:2.0:1788572456.026045:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18353:x1875453495382528:12345-192.168.202.2@tcp:36:truncate.500 00010000:00010000:2.0:1788572456.026119:0:18900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572456.026147:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01573 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115ad expref: 37 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.026168:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.026175:0:18900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572456.026447:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.026463:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.026489:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572456.026557:0:18900:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901941 00000004:00010000:2.0:1788572456.026584:0:18900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac021335 reply state 000000001e0a438a transno 12884901942 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572456.026594:0:18900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572456.026716:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+39:18353:x1875453495382528:12345-192.168.202.2@tcp:36:truncate.500 Request processed in 674us (906us total) trans 12884901942 rc 0/0 00000100:00100000:2.0:1788572456.026723:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00000020:00080000:2.0:1788572456.026729:0:18900:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1788572456.027731:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572456.029353:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.029371:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.029378:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.029384:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572456.029389:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.029397:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.029414:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572456.029418:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572456.029424:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.029431:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01581 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572456.119813:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572456.122625:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495382656 00000100:00100000:1.0:1788572456.122638:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495382656 00000100:00100000:1.0:1788572456.122698:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:1.0:1788572456.122711:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+38:18359:x1875453495382656:12345-192.168.202.2@tcp:101:truncate.500 00010000:00010000:1.0:1788572456.122739:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572456.122764:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01588 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115b4 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.122833:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.122850:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.122861:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.122876:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.122892:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.122899:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123181:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123192:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123199:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572456.123237:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 256 00000004:00200000:1.0:1788572456.123243:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572456.123309:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123333:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123342:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123348:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123355:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123372:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572456.123377:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123386:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123400:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572456.123403:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572456.123407:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123414:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c0158f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123427:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123432:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123438:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123443:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572456.123445:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123451:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123470:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058eacc00) 00010000:00010000:1.0:1788572456.123473:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572456.123476:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123482:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01596 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123514:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01588 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115b4 expref: 40 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123526:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115b4 expref: 39 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.123533:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572456.123535:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572456.124154:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386c00, rc 0) 00000100:00100000:1.0:1788572456.124330:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+39:18359:x1875453495382656:12345-192.168.202.2@tcp:101:truncate.500 Request processed in 1618us (4525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.124340:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000001:00080000:1.0:1788572456.129910:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901940 is committed 00000004:00080000:1.0:1788572456.129930:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788572456.129949:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0475719c0 refcount 2 committed 0 result 0 batchid 8589934640 00000020:00080000:1.0:1788572456.129955:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c050337400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c047571c00 00000020:00080000:1.0:1788572456.129959:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c050337800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88bf4776c000 00000001:00080000:1.0:1788572456.129982:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901942 is committed 00000020:00080000:1.0:1788572456.130289:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934640 committed batchid 8589934639 00000020:00080000:1.0:1788572456.130479:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934639 00000100:00100000:1.0:1788572456.130501:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518431104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572456.130575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572456.130655:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518431104 00000100:00100000:1.0:1788572456.130664:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518431104 00000100:00100000:1.0:1788572456.130711:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788572456.130720:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518431104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572456.130754:0:19589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:66 count 1 00002000:00010000:1.0:1788572456.130788:0:19589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 1024, mtime: 0x6a9b7327, atime: 0x6a9b7327, ctime: 0x6a9b7327, blocks: 0x1 00010000:00010000:1.0:1788572456.130796:0:19589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.130814:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788572456.130818:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572456.130826:0:19589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.130841:0:19589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.130851:0:19589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.130859:0:19589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.130890:0:19589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572456.131594:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572456.131679:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495382912 00000100:00100000:3.0:1788572456.131696:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495382912 00000100:00100000:3.0:1788572456.131742:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:3.0:1788572456.131751:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18359:x1875453495382912:12345-192.168.202.2@tcp:36:truncate.500 00010000:00010000:3.0:1788572456.131803:0:18902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572456.131831:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c0159d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115b4 expref: 16 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.131852:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:3.0:1788572456.131859:0:18902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572456.132219:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.132234:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.132244:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572456.132354:0:18902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901943 00000004:00010000:3.0:1788572456.132394:0:18902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf46c706 reply state 00000000dd3f3d69 transno 12884901944 ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572456.132402:0:18902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572456.132509:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18359:x1875453495382912:12345-192.168.202.2@tcp:36:truncate.500 Request processed in 757us (917us total) trans 12884901944 rc 0/0 00000100:00100000:3.0:1788572456.132517:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000020:00080000:3.0:1788572456.132523:0:18902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572456.133291:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572456.133304:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.133343:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572456.133348:0:19971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.133358:0:19971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.133383:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.133390:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c015a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.133409:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572456.133411:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572456.133412:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572456.134651:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518431104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3926us (4069us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788572456.134662:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788572456.134842:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c07fd12680/2, rc 0, transno 12884901892 00000100:00100000:0.0:1788572456.134850:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518431104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572456.139094:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.139112:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.139120:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.139127:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572456.139132:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.139140:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.139159:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.139178:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572456.139183:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.139190:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c015ab lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.232430:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572456.254691:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572456.255184:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495383168 00000100:00100000:1.0:1788572456.255196:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495383168 00000100:00100000:1.0:1788572456.255302:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:1.0:1788572456.255324:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+17:18365:x1875453495383168:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:1.0:1788572456.255354:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572456.255358:0:18901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572456.255386:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c014f5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1158a expref: 17 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255404:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572456.255410:0:18901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572456.255424:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015b2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115bb expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255836:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255851:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255862:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255887:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255895:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.255902:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256697:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c015c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256711:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c015c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256720:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c015c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572456.256733:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 2048 00010000:00010000:1.0:1788572456.256854:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256863:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256870:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256877:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572456.256882:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256904:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256916:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572456.256919:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572456.256924:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256930:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c015b9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256945:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256950:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256956:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256962:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572456.256965:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256971:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.256978:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058eacc00) 00010000:00010000:1.0:1788572456.256980:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572456.256983:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.257001:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c015c0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.257666:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015b2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115bb expref: 19 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.257686:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c015c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115bb expref: 18 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.257694:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572456.257697:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572456.257700:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:1.0:1788572456.257815:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18365:x1875453495383168:12345-192.168.202.2@tcp:101:dd.500 Request processed in 2502us (3135us total) trans 12884901945 rc 0/0 00000100:00100000:1.0:1788572456.257824:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:1.0:1788572456.266341:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572456.266560:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495383424 00000100:00100000:2.0:1788572456.266573:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495383424 00000100:00100000:2.0:1788572456.266638:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:2.0:1788572456.266648:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18365:x1875453495383424:12345-192.168.202.2@tcp:36:dd.500 00010000:00010000:2.0:1788572456.266708:0:18900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572456.266735:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c015c7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115bb expref: 18 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.266754:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.266760:0:18900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572456.267003:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.267017:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.267027:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572456.267082:0:18900:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901946 00000004:00010000:2.0:1788572456.267800:0:18900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df1038b4 reply state 00000000850ebc2a transno 12884901947 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572456.267833:0:18900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572456.267967:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:18365:x1875453495383424:12345-192.168.202.2@tcp:36:dd.500 Request processed in 1317us (1634us total) trans 12884901947 rc 0/0 00000100:00100000:2.0:1788572456.267975:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000020:00080000:2.0:1788572456.267981:0:18900:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572456.271612:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.271633:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.271642:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.271649:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572456.271654:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.271663:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.271685:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.271688:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572456.271695:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.271702:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c015d5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572456.280550:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572456.280755:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495383680 00000100:00100000:0.0:1788572456.280766:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495383680 00000100:00100000:0.0:1788572456.280830:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1788572456.280841:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:18365:x1875453495383680:12345-192.168.202.2@tcp:35:dd.500 00000100:00100000:0.0:1788572456.281195:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:18365:x1875453495383680:12345-192.168.202.2@tcp:35:dd.500 Request processed in 355us (662us total) trans 12884901948 rc 0/0 00000100:00100000:0.0:1788572456.281222:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1788572456.411701:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572456.411807:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495383936 00000100:00100000:1.0:1788572456.411816:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495383936 00000100:00100000:1.0:1788572456.411876:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:1.0:1788572456.411885:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:18375:x1875453495383936:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572456.411908:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572456.411941:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115c2 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572456.412031:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00010000:00010000:1.0:1788572456.412173:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115c2 expref: 22 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.412188:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:1.0:1788572456.412191:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572456.412197:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115c2 expref: 22 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.412213:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386e00, rc 0) 00000100:00100000:1.0:1788572456.412327:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18375:x1875453495383936:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 442us (634us total) trans 12884901949 rc 301/301 00000100:00100000:1.0:1788572456.412334:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:2.0:1788572456.426196:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572456.432064:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495384064 00000100:00100000:0.0:1788572456.432080:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495384064 00000100:00100000:0.0:1788572456.433290:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788572456.433323:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18375:x1875453495384064:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788572456.433431:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433447:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433459:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433476:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433483:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433489:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433810:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433819:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433826:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572456.433882:0:18900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433895:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433902:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.433909:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435159:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572456.435168:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435180:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435197:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:0.0:1788572456.435201:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572456.435206:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435212:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c015ea lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435230:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435237:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435377:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435383:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572456.435386:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435392:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435409:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c061a51200) 00010000:00010000:0.0:1788572456.435412:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572456.435416:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435422:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c015f1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435441:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435448:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435453:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435458:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572456.435460:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435477:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435485:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572456.435488:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572456.435490:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.435495:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90a00/0x977d9e7969c015f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572456.435622:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18375:x1875453495384064:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 2313us (9430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.435632:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1788572456.438427:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572456.438475:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495384320 00000100:00100000:3.0:1788572456.438489:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495384320 00000100:00100000:3.0:1788572456.438554:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788572456.438566:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18375:x1875453495384320:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788572456.438815:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18375:x1875453495384320:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 251us (409us total) trans 12884901950 rc 0/0 00000100:00100000:3.0:1788572456.438823:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788572456.600149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572456.600364:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495384448 00000100:00100000:1.0:1788572456.600379:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495384448 00000100:00100000:1.0:1788572456.600454:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1788572456.600466:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18381:x1875453495384448:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:1.0:1788572456.600495:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572456.600524:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115c9 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.600633:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01606 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.600661:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01606 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.600675:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01606 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572456.600734:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00000004:00200000:1.0:1788572456.600739:0:18902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572456.600760:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01606 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.600792:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c015ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115c9 expref: 24 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.600814:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01606 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115c9 expref: 23 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.600823:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572456.600826:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572456.600831:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387800, rc 0) 00000100:00100000:1.0:1788572456.601028:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18381:x1875453495384448:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 553us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.601036:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1788572456.616894:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572456.616991:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495384576 00000100:00100000:3.0:1788572456.617002:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495384576 00000100:00100000:3.0:1788572456.617072:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788572456.617083:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18381:x1875453495384576:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:3.0:1788572456.617114:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572456.617135:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c0160d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115d0 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617223:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617237:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617280:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617296:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617303:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617308:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617864:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617875:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617881:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572456.617912:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00000004:00200000:3.0:1788572456.617915:0:18900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572456.617934:0:18900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617944:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617952:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617970:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617977:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617983:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572456.617987:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.617994:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618007:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:3.0:1788572456.618010:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572456.618025:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618031:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c01614 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618042:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618047:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618051:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618056:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572456.618063:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618068:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618075:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058907400) 00010000:00010000:3.0:1788572456.618078:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572456.618080:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618093:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0161b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618129:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c0160d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 25 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618143:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 24 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.618150:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:3.0:1788572456.618152:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572456.618155:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c918800, rc 0) 00000100:00100000:3.0:1788572456.618218:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+24:18381:x1875453495384576:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 1137us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.618225:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:0.0:1788572456.633674:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572456.634386:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495384832 00000100:00100000:1.0:1788572456.634399:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495384832 00000100:00100000:1.0:1788572456.634489:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1788572456.634501:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+24:18381:x1875453495384832:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:1.0:1788572456.634524:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572456.634812:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01629 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115d7 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.635041:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.635077:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 25 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.635087:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.635120:0:18902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 25 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572456.635134:0:18902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 25 pid: 18900 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572456.635147:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd11500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518431232:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572456.635240:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572456.641961:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd11500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518431232:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572456.641998:0:18902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572456.644221:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572456.644336:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495384960 00000100:00100000:2.0:1788572456.644347:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495384960 00010000:00010000:2.0:1788572456.644385:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 26 pid: 18900 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572456.644430:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788572456.644440:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:2355:x1875453495384960:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572456.644455:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572456.644463:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 26 pid: 18900 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.644484:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 26 pid: 18900 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.644510:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918800/0x977d9e7969c01622 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d0 expref: 26 pid: 18900 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.644527:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.644861:0:18886:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.645110:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.645119:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.647425:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572456.647532:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:2355:x1875453495384960:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3086us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572456.647562:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:3.0:1788572456.654763:0:18902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.654784:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572456.656648:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00010000:00010000:2.0:1788572456.657741:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c01629 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 26 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.657770:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 25 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.657779:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.657782:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572456.657786:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:2.0:1788572456.658240:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:18381:x1875453495384832:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 23740us (24577us total) trans 12884901951 rc 0/0 00000100:00100000:2.0:1788572456.658280:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1788572456.795766:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572456.795867:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495385216 00000100:00100000:3.0:1788572456.795877:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495385216 00000100:00100000:3.0:1788572456.795939:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:3.0:1788572456.795948:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:18391:x1875453495385216:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572456.795970:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572456.795991:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c0163e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115de expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572456.796080:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00010000:00010000:3.0:1788572456.796206:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c0163e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115de expref: 27 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.796221:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:3.0:1788572456.796224:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572456.796230:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c0163e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115de expref: 27 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572456.796245:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c918a00, rc 0) 00000100:00100000:3.0:1788572456.796378:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:18391:x1875453495385216:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 431us (622us total) trans 12884901952 rc 301/301 00000100:00100000:3.0:1788572456.796386:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:3.0:1788572456.800499:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572456.800630:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495385344 00000100:00100000:2.0:1788572456.800644:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495385344 00000100:00100000:2.0:1788572456.800705:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:2.0:1788572456.800716:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:18391:x1875453495385344:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788572456.800804:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.800822:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.800834:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.800847:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.800864:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.800871:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801125:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801145:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801152:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572456.801191:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801202:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801208:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801215:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801220:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572456.801225:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801233:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801277:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:2.0:1788572456.801281:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572456.801287:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801388:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0164c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801401:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801407:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801413:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801418:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572456.801421:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801426:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801431:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c0593ef300) 00010000:00010000:2.0:1788572456.801433:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572456.801435:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801438:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01653 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801458:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801462:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801465:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801468:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ca00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572456.801470:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801473:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801477:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.801478:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572456.801479:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.801482:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c0165a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572456.801554:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:18391:x1875453495385344:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 839us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572456.801562:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:1.0:1788572456.813198:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572456.813467:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495385600 00000100:00100000:3.0:1788572456.813478:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495385600 00000100:00100000:3.0:1788572456.813549:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788572456.813561:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:18391:x1875453495385600:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788572456.813810:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:18391:x1875453495385600:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 250us (622us total) trans 12884901953 rc 0/0 00000100:00100000:3.0:1788572456.813818:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1788572456.871697:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572456.871786:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495385728 00000100:00100000:0.0:1788572456.871795:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495385728 00000100:00100000:0.0:1788572456.871844:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:0.0:1788572456.871852:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:18394:x1875453495385728:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572456.871874:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572456.871892:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c01661 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115e5 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.871952:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.871982:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.871992:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872003:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872008:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872012:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872333:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872345:0:18900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 28 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872353:0:18900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872386:0:18900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 28 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.872400:0:18900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 28 pid: 18902 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572456.872426:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518431360:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572456.872520:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572456.874779:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572456.874834:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495385984 00000100:00100000:3.0:1788572456.874841:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495385984 00000100:00100000:3.0:1788572456.874890:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572456.874898:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07d675850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:17521:x1875453495385984:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788572456.875114:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07d675850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:17521:x1875453495385984:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 217us (343us total) trans 12884901954 rc 0/0 00000100:00100000:3.0:1788572456.875119:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572456.875421:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518431360:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572456.875446:0:18900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572456.877191:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572456.877638:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495386112 00000100:00100000:2.0:1788572456.877648:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495386112 00010000:00010000:2.0:1788572456.877702:0:18885:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 30 pid: 18902 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572456.877789:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1788572456.877800:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:2355:x1875453495386112:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572456.877815:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572456.877822:0:18885:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 30 pid: 18902 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.877835:0:18885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 30 pid: 18902 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.877859:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c01630 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115d7 expref: 30 pid: 18902 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.877878:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572456.877884:0:18885:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.877894:0:18885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.877901:0:18885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572456.877932:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572456.877990:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:2355:x1875453495386112:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 192us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572456.877998:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:0.0:1788572456.878279:0:18900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878289:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572456.878351:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00000004:00200000:0.0:1788572456.878357:0:18900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572456.878378:0:18900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878392:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878403:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878410:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878416:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878423:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572456.878436:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878444:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878455:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:0.0:1788572456.878458:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572456.878461:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878467:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01668 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878478:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878484:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878489:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878494:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572456.878497:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878503:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878510:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c061a51200) 00010000:00010000:0.0:1788572456.878513:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572456.878523:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878529:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c0166f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878568:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c01661 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 29 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878580:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 28 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572456.878587:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572456.878589:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572456.878592:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90e00, rc 0) 00000100:00100000:0.0:1788572456.878636:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:18394:x1875453495385728:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 6783us (6948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.878643:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1788572457.064956:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518431872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572457.065108:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572457.065115:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3299:1875453518431488:0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065163:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572457.065189:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518432000:0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572457.065241:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518431488 00000100:00100000:2.0:1788572457.065271:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518431488 00000100:00100000:2.0:1788572457.065325:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788572457.065334:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3299:x1875453518431488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065386:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3299:x1875453518431488:12345-0@lo:400:kworker.0 Request processed in 54us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.065394:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788572457.065601:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3299:1875453518431488:0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065624:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518431872 00000100:00100000:2.0:1788572457.065627:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518431872 00000100:00100000:2.0:1788572457.065649:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518432000 00000100:00100000:2.0:1788572457.065652:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518432000 00000100:00100000:2.0:1788572457.065678:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572457.065685:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518431872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065722:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518431872:12345-0@lo:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.065728:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572457.065754:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518431872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065770:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788572457.065794:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572457.065829:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518432000:12345-0@lo:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.065835:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788572457.065858:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518432000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.066280:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518431744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.066327:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572457.066348:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572457.066354:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518431616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.066375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572457.066405:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518432128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.066424:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572457.066450:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518432128 00000100:00100000:1.0:1788572457.066454:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518432128 00000100:00100000:1.0:1788572457.066487:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572457.066493:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.066527:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518432128:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.066533:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572457.066558:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518432128:0@lo:400:kworker.0 00000100:00100000:0.0:1788572457.066623:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518431744 00000100:00100000:0.0:1788572457.066627:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518431744 00000100:00100000:0.0:1788572457.066662:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518431616 00000100:00100000:0.0:1788572457.066665:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518431616 00000100:00100000:0.0:1788572457.066683:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788572457.066690:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518431744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572457.066731:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518431744:12345-0@lo:400:kworker.0 Request processed in 42us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.066737:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788572457.066752:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788572457.066758:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572457.066794:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518431616:12345-0@lo:400:kworker.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.066800:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788572457.067097:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572457.067108:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518432256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572457.067150:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572457.067308:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572457.067312:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572457.067325:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572457.067435:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518432256 00000100:00100000:0.0:1788572457.067440:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518432256 00000100:00100000:0.0:1788572457.067473:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788572457.067480:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518432256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572457.067510:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788572457.067557:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518432256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.067564:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788572457.067597:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518432256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572457.068676:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518431616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.068690:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518431744:0@lo:400:kworker.0 00010000:00010000:3.0:1788572457.256438:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572457.307121:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572457.307233:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495386368 00000100:00100000:0.0:1788572457.307243:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495386368 00000100:00100000:0.0:1788572457.307338:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1788572457.307348:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:18435:x1875453495386368:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:0.0:1788572457.307379:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572457.307399:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c0167d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115ec expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.307501:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.307527:0:18900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 29 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.307535:0:18900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.307594:0:18900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 29 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.307607:0:18900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 29 pid: 18900 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572457.307621:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518432384:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572457.307717:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572457.314833:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572457.315045:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495386496 00000100:00100000:2.0:1788572457.315054:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495386496 00010000:00010000:2.0:1788572457.315109:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 30 pid: 18900 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572457.315220:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:2.0:1788572457.315232:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:2356:x1875453495386496:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572457.315276:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572457.315285:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 30 pid: 18900 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.315299:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 30 pid: 18900 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.315333:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572457.315339:0:18886:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.315347:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.315355:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.315390:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572457.315426:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c01676 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115e5 expref: 30 pid: 18900 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572457.315449:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518432384:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572457.315462:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:2356:x1875453495386496:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 231us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.315470:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00010000:00010000:0.0:1788572457.315478:0:18900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.315490:0:18900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.315832:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572457.315856:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788572457.316021:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c0167d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115ec expref: 30 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.316037:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115ec expref: 29 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.316057:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572457.316060:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572457.316064:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90400, rc 0) 00000100:00100000:0.0:1788572457.316101:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495386368:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 8755us (8990us total) trans 12884901955 rc 0/0 00000100:00100000:0.0:1788572457.316108:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1788572457.318788:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572457.318964:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495386752 00000100:00100000:0.0:1788572457.318975:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495386752 00000100:00100000:0.0:1788572457.319030:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:0.0:1788572457.319040:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495386752:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:0.0:1788572457.319067:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572457.319070:0:18901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788572457.319109:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c01684 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115ec expref: 29 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.319130:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572457.319136:0:18901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572457.319149:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01692 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115f3 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.319268:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969c01699 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.319281:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969c01699 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.319292:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969c01699 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572457.319328:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788572457.319469:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01692 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115f3 expref: 31 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.319484:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969c01699 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115f3 expref: 30 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.319492:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572457.319494:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788572457.319496:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91200, rc 0) 00000100:00100000:0.0:1788572457.319735:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18435:x1875453495386752:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 693us (960us total) trans 12884901956 rc 0/0 00000100:00100000:0.0:1788572457.319743:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1788572457.325715:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572457.326198:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387008 00000100:00100000:2.0:1788572457.326213:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387008 00000100:00100000:2.0:1788572457.326327:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788572457.326339:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4665d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18435:x1875453495387008:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:2.0:1788572457.326358:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572457.326387:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01534 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1159f expref: 30 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.326408:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572457.326413:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572457.326479:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4665d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495387008:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 142us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.326486:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788572457.329174:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572457.329345:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387136 00000100:00100000:0.0:1788572457.329356:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387136 00000100:00100000:0.0:1788572457.329432:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:0.0:1788572457.329444:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495387136:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:0.0:1788572457.329739:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.329758:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.329769:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572457.330301:0:18900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].2, 136 off8464 00000100:00100000:0.0:1788572457.331129:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495387136:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1682us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.331140:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788572457.340813:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572457.341099:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387264 00000100:00100000:1.0:1788572457.341111:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387264 00000100:00100000:1.0:1788572457.341170:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:1.0:1788572457.341181:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495387264:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572457.341204:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572457.341227:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb115fa expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.341311:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.341334:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 30 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.341372:0:18902:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.341387:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 30 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.341401:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572457.341403:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572457.341407:0:18902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 30 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.341415:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:1.0:1788572457.341485:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18435:x1875453495387264:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 305us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.341492:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000040:00080000:1.0:1788572457.961843:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788572457.961853:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572457.961895:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788572457.961902:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788572457.962028:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18933:1875453518432512:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572457.962138:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572457.972509:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572457.972661:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18933:1875453518432512:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788572457.972878:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387392 00000100:00100000:0.0:1788572457.972885:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387392 00000100:00100000:0.0:1788572457.972942:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1788572457.972953:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18436:x1875453495387392:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788572457.973000:0:18900:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788572457.973105:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18436:x1875453495387392:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 154us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.973113:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1788572457.984875:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572457.984970:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387520 00000100:00100000:0.0:1788572457.984981:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387520 00000100:00100000:0.0:1788572457.985043:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:0.0:1788572457.985053:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18436:x1875453495387520:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788572457.985130:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985148:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985161:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985176:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985183:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985209:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985233:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985241:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985282:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572457.985331:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00000004:00200000:0.0:1788572457.985335:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572457.985349:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985360:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985367:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985373:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985379:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572457.985383:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985390:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985407:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:0.0:1788572457.985410:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572457.985414:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985420:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969c016b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985432:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985437:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985442:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985447:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572457.985450:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985455:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985462:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x72e1da9d (ffff88c061a51200) 00010000:00010000:0.0:1788572457.985464:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572457.985466:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985471:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985495:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985501:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985507:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985512:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572457.985514:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985520:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985526:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572457.985528:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572457.985531:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572457.985535:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572457.985606:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18436:x1875453495387520:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 554us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.985613:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:3.0:1788572457.988421:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572457.988551:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387776 00000100:00100000:1.0:1788572457.988563:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387776 00000100:00100000:1.0:1788572457.988619:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788572457.988630:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18436:x1875453495387776:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572457.988666:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572457.988687:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c016ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11601 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.988784:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.988800:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.988812:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572457.988824:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00010000:00010000:1.0:1788572457.988938:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.988946:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.988952:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989019:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572457.989024:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989033:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989047:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572457.989056:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788572457.989062:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989069:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c016d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989114:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c016ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11601 expref: 32 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989125:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:1.0:1788572457.989127:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572457.989131:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c016ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11601 expref: 32 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572457.989141:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387e00, rc 0) 00000100:00100000:1.0:1788572457.989205:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18436:x1875453495387776:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 576us (793us total) trans 12884901957 rc 301/301 00000100:00100000:1.0:1788572457.989212:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:2.0:1788572458.000106:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.000195:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495387904 00000100:00100000:1.0:1788572458.000207:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495387904 00000100:00100000:1.0:1788572458.000300:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:1.0:1788572458.000329:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18436:x1875453495387904:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788572458.000371:0:18900:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788572458.000470:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18436:x1875453495387904:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 161us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.000477:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00080000:0.0:1788572458.000934:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572458.005494:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.005600:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495388160 00000100:00100000:0.0:1788572458.005610:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495388160 00000100:00100000:0.0:1788572458.005692:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1788572458.005703:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18436:x1875453495388160:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572458.005725:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572458.005728:0:18901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788572458.005754:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01606 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115c9 expref: 31 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.005774:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:0.0:1788572458.005779:0:18901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572458.005794:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016df lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11608 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572458.006576:0:18901:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43:0x0], index 1: 0 00010000:00010000:0.0:1788572458.006800:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.006814:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.006824:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.006887:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969c016df lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11608 expref: 33 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.006902:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11608 expref: 32 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.006910:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c061a51200) 00010000:00010000:0.0:1788572458.006918:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572458.006922:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91600, rc 0) 00000100:00100000:2.0:1788572458.018266:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18436:x1875453495388160:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 12533us (12751us total) trans 12884901958 rc 0/0 00000100:00100000:2.0:1788572458.018283:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:2.0:1788572458.025171:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.025407:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495388416 00000100:00100000:3.0:1788572458.025418:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495388416 00000100:00100000:3.0:1788572458.025497:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:3.0:1788572458.025508:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18436:x1875453495388416:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788572458.025590:0:18902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572458.025620:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c016e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11608 expref: 32 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.025640:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c061a51200) 00010000:00010000:3.0:1788572458.025653:0:18902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572458.025679:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.025695:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.025708:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.025788:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.025797:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.025805:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026030:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026040:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026059:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026066:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572458.026071:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026081:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026090:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:3.0:1788572458.026093:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572458.026097:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026104:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c016f4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026114:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026121:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026127:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026132:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572458.026136:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026153:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026162:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x9d9a4fb7 (ffff88c058907400) 00010000:00010000:3.0:1788572458.026165:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572458.026168:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.026174:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c016fb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x9d9a4fb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572458.026349:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18436:x1875453495388416:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 841us (1185us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572458.026358:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:3.0:1788572458.029591:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.029853:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495388544 00000100:00100000:2.0:1788572458.029865:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495388544 00000100:00100000:2.0:1788572458.029928:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788572458.029953:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18436:x1875453495388544:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572458.029987:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572458.030015:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01702 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1160f expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.030056:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.030069:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.030080:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.030173:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01702 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 33 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.030192:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 32 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.030201:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572458.030204:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572458.030208:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572458.030481:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18436:x1875453495388544:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 530us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.030489:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788572458.042506:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.042710:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495388800 00000100:00100000:1.0:1788572458.042734:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495388800 00000100:00100000:1.0:1788572458.042792:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:1.0:1788572458.042801:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18436:x1875453495388800:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572458.042883:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.042899:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.042912:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572458.043420:0:18900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].3, 88 off8432 00000004:00080000:1.0:1788572458.043431:0:18900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678834182231ns, next at 679834180330ns, rc = 0 00000004:00010000:1.0:1788572458.043528:0:18900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a4e536d reply state 00000000ac13430a transno 12884901959 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.043539:0:18900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572458.043892:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18436:x1875453495388800:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1088us (1393us total) trans 12884901959 rc 0/0 00000100:00100000:1.0:1788572458.043900:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00010000:00010000:2.0:1788572458.050622:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.050655:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.050662:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.050669:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572458.050674:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.050683:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.050703:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572458.050707:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572458.050712:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.050718:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c01710 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572458.050813:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.050903:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495388928 00000100:00100000:1.0:1788572458.050914:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495388928 00000100:00100000:1.0:1788572458.050984:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:1.0:1788572458.050995:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18436:x1875453495388928:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572458.051024:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572458.051044:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11616 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.051121:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 34 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.051135:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 34 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.051155:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572458.051158:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572458.051161:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387600, rc 0) 00000100:00100000:1.0:1788572458.051225:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18436:x1875453495388928:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 232us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.051232:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:0.0:1788572458.056893:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.057065:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495389056 00000100:00100000:3.0:1788572458.057074:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495389056 00000100:00100000:3.0:1788572458.057132:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1788572458.057141:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2354:x1875453495389056:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788572458.057684:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2354:x1875453495389056:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 541us (799us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788572458.057691:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00080000:0.0:1788572458.057767:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572458.061466:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.061523:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495389312 00000100:00100000:3.0:1788572458.061536:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495389312 00000100:00100000:3.0:1788572458.061600:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788572458.061608:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18436:x1875453495389312:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572458.061816:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18436:x1875453495389312:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 209us (361us total) trans 12884901960 rc 0/0 00000100:00100000:3.0:1788572458.061821:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1788572458.067812:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.067906:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495389568 00000100:00100000:0.0:1788572458.067916:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495389568 00000100:00100000:0.0:1788572458.067981:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:0.0:1788572458.067992:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18436:x1875453495389568:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788572458.068096:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18436:x1875453495389568:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.068103:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:0.0:1788572458.073092:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.073185:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495389696 00000100:00100000:1.0:1788572458.073196:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495389696 00000100:00100000:1.0:1788572458.073295:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788572458.073307:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18436:x1875453495389696:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572458.073340:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572458.073362:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c0171e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1161d expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.073438:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c01725 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.073453:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c01725 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.073484:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c01725 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572458.073522:0:18902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572458.073542:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c01725 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.073570:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c0171e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1161d expref: 37 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.073591:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c01725 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1161d expref: 36 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.073600:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572458.073602:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788572458.073606:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:1.0:1788572458.073671:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18436:x1875453495389696:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 366us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.073678:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:2.0:1788572458.076531:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.076664:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495389824 00000100:00100000:1.0:1788572458.076674:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495389824 00000100:00100000:1.0:1788572458.076734:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1788572458.076744:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2355:x1875453495389824:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572458.076761:0:19589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572458.076784:0:19589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11624 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572458.076831:0:19589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b732a, blocks: 0x1 00010000:00010000:1.0:1788572458.076850:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=678s v=(0 0) 00010000:00010000:1.0:1788572458.076854:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572458.076863:0:19589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 7 pid: 19589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.076884:0:19589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 7 pid: 19589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.076897:0:19589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387c00, rc 0) 00000100:00100000:1.0:1788572458.076953:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2355:x1875453495389824:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 210us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.076959:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1788572458.079043:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.079137:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390080 00000100:00100000:0.0:1788572458.079149:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390080 00000100:00100000:0.0:1788572458.079194:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1788572458.079203:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18436:x1875453495390080:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788572458.079339:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18436:x1875453495390080:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.079346:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1788572458.085487:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.085676:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390208 00000100:00100000:1.0:1788572458.085687:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390208 00000100:00100000:1.0:1788572458.085753:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:1.0:1788572458.085763:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:18436:x1875453495390208:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572458.085783:0:19590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572458.085802:0:19590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1162b expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.085837:0:19590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.085875:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572458.085879:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572458.085886:0:19590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 8 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.085927:0:19590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.085942:0:19590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.085958:0:19590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19590:1875453518432640:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572458.086065:0:19590:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0520786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572458.089504:0:19590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19590:1875453518432640:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572458.089548:0:19590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 8 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.089571:0:19590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386e00, rc 0) 00000100:00100000:1.0:1788572458.089636:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:18436:x1875453495390208:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3872us (4157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.089645:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788572458.090526:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.090605:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390336 00000100:00100000:2.0:1788572458.090614:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390336 00010000:00010000:2.0:1788572458.090654:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.090695:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788572458.090705:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2356:x1875453495390336:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572458.090732:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572458.090759:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.090775:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.090804:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091e4dc56/0x977d9e7969c0172c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11624 expref: 8 pid: 19589 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.090818:0:18886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572458.090823:0:18886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572458.090832:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.090842:0:18886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.090876:0:18886:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.090891:0:18886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18886:1875453518432768:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788572458.091050:0:18886:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572458.093910:0:18886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18886:1875453518432768:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572458.093932:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572458.094042:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495390336:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3338us (3520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.094051:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788572458.098705:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.098811:0:21035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390464 00000100:00100000:3.0:1788572458.098820:0:21035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390464 00002000:00100000:3.0:1788572458.098875:0:21035:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x43:0x0] (0->1023) req@ffff88c07c34c700 x1875453495390464/t0(0) o4->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:119/0 lens 1512/0 e 0 to 0 dl 1788572469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572458.098887:0:21035:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07c34c700 with x1875453495390464 ext(0->1023) 00002000:00010000:3.0:1788572458.098893:0:21035:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88c07c34c700 00000100:00100000:3.0:1788572458.098969:0:21035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572458.098980:0:21035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2355:x1875453495390464:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788572458.099502:0:21035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2355:x1875453495390464:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 520us (804us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788572458.099520:0:21035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00002000:00100000:3.0:1788572458.099528:0:21035:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x43:0x0] (0->1023) req@ffff88c07c34c700 x1875453495390464/t12884901903(0) o4->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:119/0 lens 1512/448 e 0 to 0 dl 1788572469 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572458.099537:0:21035:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07c34c700 with x1875453495390464 ext(0->1023) 00002000:00010000:3.0:1788572458.099541:0:21035:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88c07c34c700 00000100:00100000:0.0:1788572458.116892:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.117009:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390592 00000100:00100000:2.0:1788572458.117021:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390592 00000100:00100000:2.0:1788572458.117088:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:2.0:1788572458.117097:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18436:x1875453495390592:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788572458.166306:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18436:x1875453495390592:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 49197us (49416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.166331:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000001:00080000:1.0:1788572458.166477:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901958 is committed 00000001:00080000:1.0:1788572458.166497:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901959 is committed 00000004:00080000:1.0:1788572458.166501:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788572458.166542:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934640 batchid updated 00000100:00100000:0.0:1788572458.166737:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518432896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788572458.166795:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572458.166846:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518432896 00000100:00100000:0.0:1788572458.166854:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518432896 00000100:00100000:0.0:1788572458.166893:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788572458.166901:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518432896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788572458.167274:0:19589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788572458.167279:0:19589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1788572458 00002000:00010000:0.0:1788572458.167282:0:19589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788572458.167284:0:19589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 1788572458 -> 1788572458 00002000:00010000:0.0:1788572458.167286:0:19589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788572458.167337:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518432896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 436us (540us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788572458.167344:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:0.0:1788572458.167483:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bf46a65180/2, rc 0, transno 12884901904 00000100:00100000:0.0:1788572458.167490:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518432896:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788572458.167642:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901960 is committed 00000020:00080000:1.0:1788572458.167668:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934640 00000020:00080000:1.0:1788572458.167678:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934640 00000100:00100000:2.0:1788572458.170122:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.170786:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390720 00000100:00100000:3.0:1788572458.170797:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390720 00000100:00100000:2.0:1788572458.170994:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788572458.171006:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2353:x1875453495390720:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788572458.208848:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901904 is committed 00000001:00080000:1.0:1788572458.208869:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901903 is committed 00000100:00100000:3.0:1788572458.209037:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2353:x1875453495390720:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 38027us (38918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572458.209047:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788572458.211645:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.211816:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495390976 00000100:00100000:1.0:1788572458.211826:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495390976 00000100:00100000:1.0:1788572458.211902:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:1.0:1788572458.211913:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18436:x1875453495390976:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572458.211970:0:18902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572458.211997:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969c01725 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1161d expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.212020:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572458.212026:0:18902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572458.212057:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.212070:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.212080:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572458.212304:0:18902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddb9f571 reply state 00000000b09709ab transno 12884901961 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.212312:0:18902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572458.212508:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:18436:x1875453495390976:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 595us (870us total) trans 12884901961 rc 0/0 00000100:00100000:1.0:1788572458.212525:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00010000:00010000:2.0:1788572458.214856:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.214875:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.214883:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.214891:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572458.214896:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.214905:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.214924:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572458.214928:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572458.214933:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.214961:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c0173a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572458.216780:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.217050:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495391104 00000100:00100000:0.0:1788572458.217062:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495391104 00000100:00100000:0.0:1788572458.217125:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1788572458.217137:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2356:x1875453495391104:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788572458.217481:0:19589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:0.0:1788572458.217485:0:19589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 1788572458 -> 1788572456 00002000:00010000:0.0:1788572458.217487:0:19589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb atime from disk: 0 -> 1788572455 00002000:00010000:0.0:1788572458.217489:0:19589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 1788572458 -> 1788572456 00002000:00010000:0.0:1788572458.217491:0:19589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788572458.217564:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495391104:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 429us (796us total) trans 12884901905 rc 0/0 00000100:00100000:0.0:1788572458.217588:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1788572458.220976:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.221056:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495391360 00000100:00100000:0.0:1788572458.221067:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495391360 00000100:00100000:0.0:1788572458.221125:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:0.0:1788572458.221135:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18436:x1875453495391360:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788572458.221216:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.221234:0:18901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 18 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.221243:0:18901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.221314:0:18901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 18 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.221339:0:18901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 18 pid: 18901 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.221354:0:18901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518433024:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572458.221450:0:18901:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572458.223851:0:18901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518433024:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572458.223887:0:18901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.224988:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.225073:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495391488 00000100:00100000:0.0:1788572458.225096:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495391488 00010000:00010000:0.0:1788572458.225132:0:18887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 19 pid: 18901 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.225170:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788572458.225178:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:2355:x1875453495391488:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572458.225191:0:18887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572458.225198:0:18887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 19 pid: 18901 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.225211:0:18887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 19 pid: 18901 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.225232:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c01709 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1160f expref: 19 pid: 18901 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.225288:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:0.0:1788572458.225293:0:18887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.225304:0:18887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.225312:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.225348:0:18887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572458.225409:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:2355:x1875453495391488:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 231us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.225427:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00010000:00010000:2.0:1788572458.225565:0:18901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225575:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225603:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225610:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225617:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225623:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572458.225627:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225634:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225643:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572458.225646:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788572458.225649:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.225656:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969c01741 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.225699:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+17:18436:x1875453495391360:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 4566us (4734us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788572458.225707:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:1.0:1788572458.228756:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.228887:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495391616 00000100:00100000:2.0:1788572458.228896:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495391616 00000100:00100000:2.0:1788572458.228956:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788572458.228966:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495391616:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788572458.229018:0:19590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.229042:0:19590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.229052:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x43:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788572458.229057:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572458.229062:0:19590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.229102:0:19590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 7 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.229118:0:19590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 7 pid: 19590 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.229135:0:19590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0506bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19590:1875453518433152:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572458.229234:0:19590:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c048538cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572458.232836:0:19590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0506bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19590:1875453518433152:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572458.232868:0:19590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.234032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.234108:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495391744 00000100:00100000:2.0:1788572458.234118:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495391744 00010000:00010000:2.0:1788572458.234173:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 8 pid: 19590 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.234216:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788572458.234228:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2356:x1875453495391744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572458.234244:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572458.234291:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 8 pid: 19590 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.234304:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 8 pid: 19590 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.234341:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf50f64/0x977d9e7969c01733 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1162b expref: 8 pid: 19590 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.234361:0:18886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572458.234373:0:18886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572458.234380:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.234407:0:18886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.234438:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572458.234501:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495391744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 275us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.234509:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:1.0:1788572458.234624:0:19590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234634:0:19590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234658:0:19590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234666:0:19590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234674:0:19590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234681:0:19590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572458.234686:0:19590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234694:0:19590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234720:0:19590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.234728:0:19590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c01748 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.234775:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2356:x1875453495391616:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 5811us (6030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.234783:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788572458.237458:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.237542:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392000 00000100:00100000:0.0:1788572458.237561:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392000 00000100:00100000:0.0:1788572458.237622:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:0.0:1788572458.237634:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+17:18436:x1875453495392000:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788572458.237722:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.237742:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.237754:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.237981:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.237993:0:18900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.238002:0:18900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.238040:0:18900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.238055:0:18900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 18 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.238093:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518433280:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572458.238425:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572458.241089:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518433280:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572458.241133:0:18900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.242698:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.242787:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392128 00000100:00100000:3.0:1788572458.242799:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392128 00010000:00010000:3.0:1788572458.242841:0:18885:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 19 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572458.242884:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572458.242894:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:2356:x1875453495392128:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572458.242911:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572458.242918:0:18885:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 19 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.242932:0:18885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 19 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.242956:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969c01717 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11616 expref: 19 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.242976:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572458.242982:0:18885:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.242992:0:18885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.243000:0:18885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.243052:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572458.243118:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:2356:x1875453495392128:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 225us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572458.243127:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00010000:00010000:0.0:1788572458.243834:0:18900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.243844:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572458.244034:0:18900:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901962 00000001:00080000:0.0:1788572458.244187:0:18900:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901963 00000001:00080000:0.0:1788572458.244233:0:18900:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901964 00000100:00100000:0.0:1788572458.244383:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18900:1875453518433408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788572458.244436:0:18900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572458.244516:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0475719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572458.244949:0:18905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518433408 00000100:00100000:2.0:1788572458.244957:0:18905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518433408 00000100:00100000:2.0:1788572458.245032:0:18905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788572458.245042:0:18905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18900:x1875453518433408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572458.245140:0:18905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18900:x1875453518433408:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.245147:0:18905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572458.245212:0:18900:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901904 gen 2 00000004:00080000:1.0:1788572458.245219:0:18900:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bf46a65180, transno 12884901904 00000100:00100000:1.0:1788572458.245241:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18900:1875453518433408:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788572458.245745:0:18900:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901965 00000100:00100000:1.0:1788572458.245812:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18900:1875453518433536:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572458.245847:0:18900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572458.247037:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052e0b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572458.247086:0:18906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518433536 00000100:00100000:0.0:1788572458.247094:0:18906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518433536 00000100:00100000:0.0:1788572458.247196:0:18906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572458.247208:0:18906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18900:x1875453518433536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788572458.252118:0:18906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18900:x1875453518433536:12345-0@lo:1000:mdt00_000.0 Request processed in 4904us (6260us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788572458.252133:0:18906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788572458.252208:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18900:1875453518433536:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788572458.252318:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252340:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252437:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252444:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572458.252449:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252458:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252477:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572458.252480:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572458.252485:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252492:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969c01756 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252529:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252536:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252541:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252545:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572458.252610:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252628:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252636:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:1.0:1788572458.252638:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572458.252645:0:18900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 21 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252656:0:18900:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 21 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252665:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 21 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.252701:0:18900:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 21 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.252714:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45195880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518433664:192.168.202.2@tcp:105: 00000100:00100000:1.0:1788572458.252979:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a02c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788572458.255943:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.256044:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45195880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18900:1875453518433664:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788572458.256084:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256095:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c016a7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256129:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256144:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256156:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256168:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256174:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256181:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256187:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572458.256191:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256198:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256209:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572458.256211:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572458.256221:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256227:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969c0175d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256237:0:18900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256243:0:18900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256282:0:18900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256288:0:18900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572458.256291:0:18900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256298:0:18900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256305:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:0.0:1788572458.256308:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788572458.256310:0:18900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.256316:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c0174f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.256689:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18436:x1875453495392000:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 19054us (19240us total) trans 12884901966 rc 0/0 00000100:00100000:0.0:1788572458.256700:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000020:00080000:0.0:1788572458.256712:0:18900:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788572458.256888:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788572458.256892:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572458.256915:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788572458.256919:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788572458.259218:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392256 00000100:00100000:3.0:1788572458.259233:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392256 00000100:00100000:3.0:1788572458.259319:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788572458.259339:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18435:x1875453495392256:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:3.0:1788572458.259852:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18435:x1875453495392256:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 513us (3918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572458.259860:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788572458.259979:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.260613:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392512 00000100:00100000:0.0:1788572458.260622:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392512 00000100:00100000:0.0:1788572458.260659:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:0.0:1788572458.260668:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+21:18436:x1875453495392512:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788572458.263017:0:18904:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788572458.263395:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901967 00010000:00010000:0.0:1788572458.263480:0:18904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.263498:0:18904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.263511:0:18904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.263521:0:18904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.263527:0:18904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.263535:0:18904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.263814:0:18904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572458.263933:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18436:x1875453495392512:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 3260us (3949us total) trans 12884901968 rc 0/0 00000100:00100000:0.0:1788572458.263943:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000020:00080000:0.0:1788572458.263949:0:18904:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572458.264082:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572458.264092:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.264100:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572458.264104:0:19971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.264113:0:19971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.264126:0:19971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff88c061a51300) 00010000:00010000:2.0:1788572458.264138:0:19971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572458.264144:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.264150:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969c01764 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.264167:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572458.264169:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572458.264171:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572458.267057:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.267170:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392640 00000100:00100000:0.0:1788572458.267198:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392640 00000100:00100000:0.0:1788572458.267280:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788572458.267290:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:18435:x1875453495392640:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572458.267311:0:19589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572458.267343:0:19589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11632 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572458.267383:0:19589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 1024, mtime: 0x6a9b7328, atime: 0x6a9b7327, ctime: 0x6a9b7328, blocks: 0xb 00010000:00010000:0.0:1788572458.267410:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788572458.267415:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572458.267426:0:19589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 7 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.267444:0:19589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 7 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.267457:0:19589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90600, rc 0) 00000100:00100000:0.0:1788572458.267849:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:18435:x1875453495392640:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 558us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.267856:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1788572458.270829:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.270895:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392768 00000100:00100000:2.0:1788572458.270904:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392768 00002000:00100000:2.0:1788572458.270953:0:19595:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x43:0x0] (0->4095) req@ffff88c049a48700 x1875453495392768/t0(0) o3->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:119/0 lens 488/0 e 0 to 0 dl 1788572469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788572458.270965:0:19595:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c049a48700 with x1875453495392768 ext(0->4095) 00002000:00010000:2.0:1788572458.270971:0:19595:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88c049a48700 00000100:00100000:2.0:1788572458.271000:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788572458.271010:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495392768:12345-192.168.202.2@tcp:3:lfs.0 00000100:00100000:2.0:1788572458.271931:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495392768:12345-192.168.202.2@tcp:3:lfs.0 Request processed in 916us (1108us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788572458.271941:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00002000:00100000:2.0:1788572458.271952:0:19595:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x43:0x0] (0->4095) req@ffff88c049a48700 x1875453495392768/t0(0) o3->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:119/0 lens 488/4536 e 0 to 0 dl 1788572469 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788572458.271961:0:19595:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c049a48700 with x1875453495392768 ext(0->4095) 00002000:00010000:2.0:1788572458.271966:0:19595:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88c049a48700 00000100:00100000:3.0:1788572458.275667:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.275763:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495392896 00000100:00100000:2.0:1788572458.275786:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495392896 00000100:00100000:2.0:1788572458.275884:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788572458.275895:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2355:x1875453495392896:12345-192.168.202.2@tcp:1:lfs.500 00010000:00010000:2.0:1788572458.275945:0:19591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.275965:0:19591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 7 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.275974:0:19591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572458.275979:0:19591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572458.275983:0:19591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.276018:0:19591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 7 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.276032:0:19591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 7 pid: 19589 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.276046:0:19591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07bfb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19591:1875453518433792:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572458.276134:0:19591:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572458.279064:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.279191:0:19591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07bfb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19591:1875453518433792:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572458.279220:0:19591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572458.279490:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495393024 00000100:00100000:3.0:1788572458.279498:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495393024 00010000:00010000:3.0:1788572458.279538:0:18887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 8 pid: 19589 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572458.279584:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788572458.279595:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2356:x1875453495393024:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572458.279612:0:18887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572458.279638:0:18887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 8 pid: 19589 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.279651:0:18887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 8 pid: 19589 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.279682:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009090881f/0x977d9e7969c0176b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11632 expref: 8 pid: 19589 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.279699:0:18887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572458.279704:0:18887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572458.279710:0:18887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.279720:0:18887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.279791:0:18887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572458.279843:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495393024:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 250us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572458.279850:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00010000:00010000:2.0:1788572458.280381:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572458.281434:0:19591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281449:0:19591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281500:0:19591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281509:0:19591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281517:0:19591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281525:0:19591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572458.281529:0:19591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281539:0:19591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281614:0:19591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.281623:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad2363b7/0x977d9e7969c01772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.281750:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2355:x1875453495392896:12345-192.168.202.2@tcp:1:lfs.500 Request processed in 5853us (6086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.281759:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788572458.284050:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.284124:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495393280 00000100:00100000:1.0:1788572458.284143:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495393280 00000100:00100000:1.0:1788572458.284200:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:1.0:1788572458.284211:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18435:x1875453495393280:12345-192.168.202.2@tcp:35:lfs.500 00000004:00010000:1.0:1788572458.284354:0:18904:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000013a1:0x5:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969c01699 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115f3 expref: 23 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572458.284930:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901969 00000001:00080000:0.0:1788572458.286032:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901970 00010000:00010000:0.0:1788572458.286105:0:18904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.286127:0:18904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 26 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.286232:0:18904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.286360:0:18904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 26 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.286449:0:18904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 26 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.286466:0:18904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:18904:1875453518433920:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572458.286677:0:18904:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0475719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572458.289546:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.289735:0:18904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:18904:1875453518433920:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572458.289763:0:18904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.289956:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495393408 00000100:00100000:2.0:1788572458.289964:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495393408 00010000:00010000:2.0:1788572458.290008:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 27 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.290097:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788572458.290107:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:2356:x1875453495393408:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572458.290122:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572458.290139:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 27 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.290153:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 27 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.290176:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c016ae lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115fa expref: 27 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.290195:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572458.290200:0:18886:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.290209:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.290217:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.290282:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572458.290353:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:2356:x1875453495393408:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 247us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.290361:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00010000:00010000:0.0:1788572458.291067:0:18904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.291078:0:18904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572458.291211:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901971 00000001:00080000:0.0:1788572458.291489:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901972 00000100:00100000:0.0:1788572458.291605:0:18904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:18904:1875453518434048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788572458.291672:0:18904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572458.291702:0:18904:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572458.292295:0:18905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518434048 00000100:00100000:1.0:1788572458.292304:0:18905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518434048 00000100:00100000:1.0:1788572458.292355:0:18905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572458.292373:0:18905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18904:x1875453518434048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788572458.292443:0:18905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18904:x1875453518434048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.292449:0:18905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572458.292758:0:18904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:18904:1875453518434048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788572458.293357:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901973 00000100:00100000:0.0:1788572458.293504:0:18904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:18904:1875453518434176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788572458.293611:0:18904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572458.293681:0:18904:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572458.293820:0:18905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518434176 00000100:00100000:1.0:1788572458.293826:0:18905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518434176 00000100:00100000:1.0:1788572458.293895:0:18905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788572458.293903:0:18905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18904:x1875453518434176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788572458.294088:0:18905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18904:x1875453518434176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 185us (537us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788572458.294095:0:18905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788572458.294165:0:18904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:18904:1875453518434176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788572458.294215:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901974 00010000:00010000:2.0:1788572458.294273:0:18904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.294284:0:18904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.294292:0:18904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.294298:0:18904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572458.294303:0:18904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.294312:0:18904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.294338:0:18904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572458.294341:0:18904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788572458.294347:0:18904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.294353:0:18904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90c00/0x977d9e7969c01779 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572458.294632:0:18904:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788572458.294710:0:18904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].4, 64 off8496 00000001:00080000:2.0:1788572458.294717:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901975 00010000:00010000:2.0:1788572458.294747:0:18904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c058eacb00) 00010000:00010000:2.0:1788572458.294749:0:18904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788572458.294756:0:18904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969c01699 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb115f3 expref: 30 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.294852:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495393280:12345-192.168.202.2@tcp:35:lfs.500 Request processed in 10643us (10811us total) trans 12884901976 rc 0/0 00000100:00100000:2.0:1788572458.294877:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000020:00080000:2.0:1788572458.294881:0:18904:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1788572458.297387:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.297735:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495393536 00000100:00100000:2.0:1788572458.297747:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495393536 00000100:00100000:2.0:1788572458.297813:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:2.0:1788572458.297823:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+29:18435:x1875453495393536:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572458.297848:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572458.297871:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01780 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11639 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.297939:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01780 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11639 expref: 30 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.297954:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01780 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11639 expref: 30 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.297975:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572458.297992:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572458.297997:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572458.298061:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18435:x1875453495393536:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 238us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.298068:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:3.0:1788572458.300345:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.300450:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495393792 00000100:00100000:0.0:1788572458.300459:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495393792 00000100:00100000:0.0:1788572458.300511:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:0.0:1788572458.300522:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07d675c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18435:x1875453495393792:12345-192.168.202.2@tcp:35:lfs.500 00000100:00100000:0.0:1788572458.300789:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07d675c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18435:x1875453495393792:12345-192.168.202.2@tcp:35:lfs.500 Request processed in 269us (452us total) trans 12884901977 rc 0/0 00000100:00100000:0.0:1788572458.300797:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:0.0:1788572458.390865:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.391045:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495394048 00000100:00100000:1.0:1788572458.391055:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495394048 00000100:00100000:1.0:1788572458.391126:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:1.0:1788572458.391148:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+31:18447:x1875453495394048:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572458.391176:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572458.391198:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11640 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572458.391387:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00010000:00010000:1.0:1788572458.391507:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01787 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11640 expref: 33 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.391522:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:1.0:1788572458.391525:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572458.391530:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11640 expref: 33 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.391546:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387800, rc 0) 00000100:00100000:1.0:1788572458.391624:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18447:x1875453495394048:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 479us (769us total) trans 12884901978 rc 301/301 00000100:00100000:1.0:1788572458.391631:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:3.0:1788572458.400219:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572458.400374:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495394176 00000100:00100000:1.0:1788572458.400386:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495394176 00000100:00100000:1.0:1788572458.400438:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:1.0:1788572458.400450:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18447:x1875453495394176:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1788572458.400538:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.400565:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.400577:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.400593:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.400614:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.400622:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401011:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401021:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401027:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572458.401070:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401082:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401089:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401096:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401101:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572458.401105:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401113:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401132:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572458.401135:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572458.401139:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401146:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387800/0x977d9e7969c01795 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401158:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401164:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401169:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401173:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572458.401176:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401181:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401187:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058eacc00) 00010000:00010000:1.0:1788572458.401189:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572458.401191:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401196:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0179c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401219:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401225:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401232:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401237:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572458.401240:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401445:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401455:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:1.0:1788572458.401457:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572458.401460:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572458.401465:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387e00/0x977d9e7969c017a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572458.401585:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18447:x1875453495394176:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1134us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572458.401594:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:0.0:1788572458.408688:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.408786:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495394432 00000100:00100000:3.0:1788572458.408900:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495394432 00000100:00100000:3.0:1788572458.409007:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1788572458.409019:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+32:18447:x1875453495394432:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788572458.409341:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18447:x1875453495394432:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 324us (662us total) trans 12884901979 rc 0/0 00000100:00100000:3.0:1788572458.409350:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788572458.527653:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.527878:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495394560 00000100:00100000:2.0:1788572458.527888:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495394560 00000100:00100000:2.0:1788572458.528079:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:2.0:1788572458.528089:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+33:18453:x1875453495394560:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:2.0:1788572458.528113:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572458.528135:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c017aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11647 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.528206:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c017b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.528220:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c017b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.528231:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c017b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572458.528296:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00000004:00200000:2.0:1788572458.528300:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572458.528317:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c017b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.528354:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c017aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11647 expref: 35 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.528391:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c017b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11647 expref: 34 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.528399:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:2.0:1788572458.528402:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572458.528407:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:2.0:1788572458.528525:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18453:x1875453495394560:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 437us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.528533:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:1.0:1788572458.532032:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572458.532146:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495394688 00000100:00100000:3.0:1788572458.532156:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495394688 00000100:00100000:3.0:1788572458.532218:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:3.0:1788572458.532228:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+34:18453:x1875453495394688:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:3.0:1788572458.532270:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572458.532292:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c017b8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1164e expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532374:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532390:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532412:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532428:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532435:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532443:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532696:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532705:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532724:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572458.532755:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1788572458.532760:0:18902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572458.532779:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532791:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532799:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532804:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532811:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532816:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572458.532820:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532828:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532841:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:3.0:1788572458.532844:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572458.532849:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532865:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c017bf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532879:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532884:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532902:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532907:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572458.532910:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532916:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532924:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c058907400) 00010000:00010000:3.0:1788572458.532927:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572458.532931:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532936:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c017c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532970:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c017b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 36 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.532997:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 35 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572458.533003:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572458.533006:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572458.533008:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c919a00, rc 0) 00000100:00100000:3.0:1788572458.533085:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18453:x1875453495394688:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 858us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572458.533098:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:3.0:1788572458.537496:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.537702:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495394944 00000100:00100000:2.0:1788572458.537713:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495394944 00000100:00100000:2.0:1788572458.537783:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:2.0:1788572458.537794:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18453:x1875453495394944:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:2.0:1788572458.537818:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572458.537846:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c017d4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11655 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.537951:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.537967:0:18901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 36 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.537976:0:18901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.538012:0:18901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 36 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.538047:0:18901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 36 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.538062:0:18901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07bfb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518434304:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572458.538162:0:18901:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572458.540689:0:18901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07bfb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518434304:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572458.540720:0:18901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572458.546435:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.546941:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495395072 00000100:00100000:2.0:1788572458.546952:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495395072 00010000:00010000:2.0:1788572458.546994:0:18885:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 37 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572458.547050:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1788572458.547061:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4665c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:2355:x1875453495395072:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572458.547075:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572458.547083:0:18885:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 37 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.547096:0:18885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 37 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.547117:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919a00/0x977d9e7969c017cd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1164e expref: 37 pid: 18902 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.547154:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572458.547160:0:18885:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.547168:0:18885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.547176:0:18885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.547210:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572458.547725:0:18901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.547735:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572458.547760:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:0.0:1788572458.547929:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c017d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 38 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.547958:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 37 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.547966:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:0.0:1788572458.547968:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572458.547971:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572458.548024:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4665c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:2355:x1875453495395072:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 963us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.548048:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788572458.555795:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18453:x1875453495394944:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 17990us (18298us total) trans 12884901980 rc 0/0 00000100:00100000:0.0:1788572458.555810:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:1.0:1788572458.571897:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572458.572024:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495395328 00000100:00100000:2.0:1788572458.572425:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495395328 00000100:00100000:2.0:1788572458.572495:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:2.0:1788572458.572507:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18453:x1875453495395328:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:2.0:1788572458.572524:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572458.572556:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01780 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11639 expref: 36 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572458.572575:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572458.572581:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572458.572644:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18453:x1875453495395328:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 139us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572458.572651:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572458.575069:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.575320:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495395456 00000100:00100000:0.0:1788572458.575339:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495395456 00000100:00100000:0.0:1788572458.575398:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:0.0:1788572458.575408:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18453:x1875453495395456:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:0.0:1788572458.575514:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.575533:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.575545:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572458.575982:0:18900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].3, 136 off8600 00000100:00100000:0.0:1788572458.576447:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18453:x1875453495395456:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1037us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.576457:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:1.0:1788572458.580349:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572458.580452:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495395584 00000100:00100000:0.0:1788572458.580474:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495395584 00000100:00100000:0.0:1788572458.580661:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:0.0:1788572458.580672:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+35:18453:x1875453495395584:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572458.580693:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572458.580714:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1165c expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.580777:0:18901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.580791:0:18901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 36 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.580812:0:18901:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.580825:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 36 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.580838:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:0.0:1788572458.580841:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572458.580845:0:18901:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 36 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572458.580853:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91c00, rc 0) 00000100:00100000:0.0:1788572458.580946:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18453:x1875453495395584:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 276us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572458.580953:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:1.0:1788572459.112605:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572459.112630:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518434432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572459.112709:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572459.113347:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518434432 00000100:00100000:3.0:1788572459.113357:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518434432 00000100:00100000:3.0:1788572459.113512:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572459.113522:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518434432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572459.113564:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572459.113677:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518434432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.113684:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788572459.114303:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572459.125615:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518434432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788572459.304704:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572459.305499:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788572459.305506:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572459.305539:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 4 00000040:00080000:1.0:1788572459.305545:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788572459.305678:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18933:1875453518434560:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572459.305786:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a02cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572459.309651:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18933:1875453518434560:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572459.311816:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.312043:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495395712 00000100:00100000:0.0:1788572459.312063:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495395712 00000100:00100000:0.0:1788572459.312125:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:0.0:1788572459.312135:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18454:x1875453495395712:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788572459.312166:0:18900:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788572459.312320:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18454:x1875453495395712:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 186us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.312338:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:1.0:1788572459.317405:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.319170:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495395840 00000100:00100000:0.0:1788572459.319185:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495395840 00000100:00100000:0.0:1788572459.319292:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:0.0:1788572459.319302:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18454:x1875453495395840:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788572459.319393:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319411:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319422:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319439:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319447:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319473:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319500:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319508:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.319516:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572459.319552:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00000004:00200000:0.0:1788572459.320657:0:18901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572459.320678:0:18901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320759:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320768:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320776:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320782:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572459.320787:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320794:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320821:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:0.0:1788572459.320824:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572459.320829:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320836:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91a00/0x977d9e7969c017f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320850:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320856:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320862:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320867:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572459.320870:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320875:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320881:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x72e1da9d (ffff88c061a51e00) 00010000:00010000:0.0:1788572459.320883:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572459.320886:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320891:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c017fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x72e1da9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320915:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320921:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320926:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320931:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572459.320934:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320939:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320947:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:0.0:1788572459.320949:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572459.320952:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.320958:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01805 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572459.321115:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18454:x1875453495395840:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 1810us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.321124:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:1.0:1788572459.334459:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.334587:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495396096 00000100:00100000:3.0:1788572459.334599:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495396096 00000100:00100000:3.0:1788572459.334663:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:3.0:1788572459.334674:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+36:18454:x1875453495396096:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572459.334708:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572459.334733:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c0180c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11663 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.334877:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.334892:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.334905:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572459.334918:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788572459.335033:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335041:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335048:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335054:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572459.335058:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335066:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335079:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572459.335082:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572459.335086:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335102:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01813 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335147:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c0180c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11663 expref: 38 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335158:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:3.0:1788572459.335160:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572459.335165:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c0180c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11663 expref: 38 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.335175:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c918a00, rc 0) 00000100:00100000:3.0:1788572459.335275:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18454:x1875453495396096:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 573us (798us total) trans 12884901981 rc 301/301 00000100:00100000:3.0:1788572459.335284:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1788572459.342848:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.342943:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495396224 00000100:00100000:0.0:1788572459.342953:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495396224 00000100:00100000:0.0:1788572459.343016:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:0.0:1788572459.343043:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18454:x1875453495396224:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788572459.343098:0:18901:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788572459.343217:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18454:x1875453495396224:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 175us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.343225:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:2.0:1788572459.348124:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572459.348577:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495396480 00000100:00100000:1.0:1788572459.348589:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495396480 00000100:00100000:1.0:1788572459.348644:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788572459.348653:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18454:x1875453495396480:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572459.348674:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572459.348678:0:18900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572459.348712:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c017b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11647 expref: 37 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.348733:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572459.348739:0:18900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572459.348753:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01821 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1166a expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572459.349366:0:18900:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43:0x0], index 0: 0 00010000:00010000:1.0:1788572459.349569:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c01828 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.349584:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c01828 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.349595:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c01828 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.349655:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c01821 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1166a expref: 39 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.349669:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c01828 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1166a expref: 38 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.349676:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:1.0:1788572459.349678:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572459.349681:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:1.0:1788572459.349749:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+38:18454:x1875453495396480:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1096us (1636us total) trans 12884901982 rc 0/0 00000100:00100000:1.0:1788572459.349756:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788572459.353104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.353199:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495396736 00000100:00100000:0.0:1788572459.353209:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495396736 00000100:00100000:0.0:1788572459.353313:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1788572459.353324:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+38:18454:x1875453495396736:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788572459.353397:0:18901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572459.353428:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c01828 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1166a expref: 38 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.353449:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:0.0:1788572459.353460:0:18901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572459.353485:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.353498:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.353508:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.353574:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.353581:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.353602:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354533:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354545:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354552:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354557:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572459.354562:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354570:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354582:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:2.0:1788572459.354584:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572459.354589:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354595:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01836 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354605:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354612:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354618:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354636:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572459.354639:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354645:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354653:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x3c7cb69d (ffff88c061a51e00) 00010000:00010000:2.0:1788572459.354655:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572459.354658:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.354664:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c0183d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x3c7cb69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572459.354770:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18454:x1875453495396736:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1444us (1674us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572459.354778:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:2.0:1788572459.364017:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.364467:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495396864 00000100:00100000:3.0:1788572459.364478:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495396864 00000100:00100000:3.0:1788572459.364546:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:3.0:1788572459.364669:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+37:18454:x1875453495396864:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572459.364693:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572459.364720:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01844 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11671 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.364773:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.364788:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.364817:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.364933:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01844 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 39 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.364951:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 38 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.364959:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:3.0:1788572459.364962:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572459.364965:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c919400, rc 0) 00000100:00100000:3.0:1788572459.365600:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+38:18454:x1875453495396864:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1040us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.365608:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1788572459.379972:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.380360:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495397120 00000100:00100000:2.0:1788572459.380431:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495397120 00000100:00100000:2.0:1788572459.380494:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:2.0:1788572459.380505:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+38:18454:x1875453495397120:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572459.380621:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.380639:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.380663:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572459.381685:0:18901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].3, 88 off8408 00000004:00080000:2.0:1788572459.381698:0:18901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680172449011ns, next at 681172446537ns, rc = 0 00000004:00010000:2.0:1788572459.381871:0:18901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0b59176 reply state 0000000013aa4bce transno 12884901983 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572459.381883:0:18901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572459.382133:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+40:18454:x1875453495397120:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1627us (2166us total) trans 12884901983 rc 0/0 00000100:00100000:2.0:1788572459.382141:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:2.0:1788572459.394670:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572459.395406:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495397248 00000100:00100000:1.0:1788572459.395419:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495397248 00000100:00100000:1.0:1788572459.395490:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:1.0:1788572459.395502:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+40:18454:x1875453495397248:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572459.395543:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572459.395577:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11678 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.395638:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 41 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.395654:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 41 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.395675:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:1.0:1788572459.395679:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572459.395683:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386c00, rc 0) 00000100:00100000:1.0:1788572459.395921:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+41:18454:x1875453495397248:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 421us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572459.395928:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00010000:00010000:3.0:1788572459.396748:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.396761:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.396769:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.396775:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572459.396780:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.396788:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.396813:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:3.0:1788572459.396816:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572459.396820:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.396827:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c01852 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572459.403027:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.403293:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495397376 00000100:00100000:2.0:1788572459.403304:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495397376 00000100:00080000:0.0:1788572459.403482:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572459.403566:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1788572459.403579:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495397376:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788572459.403941:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2356:x1875453495397376:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 362us (923us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788572459.403949:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788572459.407970:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.408346:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495397632 00000100:00100000:3.0:1788572459.408358:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495397632 00000100:00100000:3.0:1788572459.408423:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1788572459.408435:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+40:18454:x1875453495397632:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572459.408742:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+41:18454:x1875453495397632:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 308us (781us total) trans 12884901984 rc 0/0 00000100:00100000:3.0:1788572459.408751:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788572459.412450:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.412542:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495397888 00000100:00100000:2.0:1788572459.412553:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495397888 00000100:00100000:2.0:1788572459.412622:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:2.0:1788572459.412633:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+41:18454:x1875453495397888:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788572459.412762:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+41:18454:x1875453495397888:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 131us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.412785:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:3.0:1788572459.415930:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.416096:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398016 00000100:00100000:0.0:1788572459.416106:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398016 00000100:00100000:0.0:1788572459.416172:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:0.0:1788572459.416182:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+41:18454:x1875453495398016:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572459.416204:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572459.416228:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c01860 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1167f expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.416377:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01867 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.416393:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01867 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.416405:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01867 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572459.416442:0:18900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572459.416460:0:18900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01867 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.416483:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91400/0x977d9e7969c01860 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1167f expref: 43 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.416514:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01867 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1167f expref: 42 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.416522:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:0.0:1788572459.416525:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788572459.416529:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90200, rc 0) 00000100:00100000:0.0:1788572459.416599:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+42:18454:x1875453495398016:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 418us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.416606:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:0.0:1788572459.420496:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572459.420888:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398144 00000100:00100000:1.0:1788572459.420899:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398144 00000100:00100000:1.0:1788572459.420963:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:1.0:1788572459.420974:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0506bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2354:x1875453495398144:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572459.420997:0:19590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572459.421020:0:19590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11686 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572459.421161:0:19590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b732b, blocks: 0x1 00010000:00010000:1.0:1788572459.421187:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1788572459.421205:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572459.421217:0:19590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 9 pid: 19590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.421240:0:19590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 9 pid: 19590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.421453:0:19590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387c00, rc 0) 00000100:00100000:0.0:1788572459.421622:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0506bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2354:x1875453495398144:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 648us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.421629:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:1.0:1788572459.425440:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.425613:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398400 00000100:00100000:3.0:1788572459.425624:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398400 00000100:00100000:3.0:1788572459.425677:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788572459.425688:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+42:18454:x1875453495398400:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788572459.425820:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+42:18454:x1875453495398400:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.425828:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788572459.430507:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572459.430607:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398528 00000100:00100000:1.0:1788572459.430618:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398528 00000100:00100000:1.0:1788572459.430682:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1788572459.430692:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:18454:x1875453495398528:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572459.430712:0:19589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572459.430744:0:19589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1168d expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.430777:0:19589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 10 pid: 19590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.430786:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572459.430792:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572459.430798:0:19589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 10 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.430836:0:19589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 10 pid: 19590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.430874:0:19589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 10 pid: 19590 timeout: 780 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572459.430889:0:19589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19589:1875453518434688:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572459.430989:0:19589:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a02cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572459.435776:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.435933:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398656 00000100:00100000:3.0:1788572459.435944:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398656 00010000:00010000:3.0:1788572459.436010:0:18885:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 11 pid: 19590 timeout: 780 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.436068:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1788572459.436079:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+11:2356:x1875453495398656:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572459.436095:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572459.436121:0:18885:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 11 pid: 19590 timeout: 780 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.436147:0:18885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 11 pid: 19590 timeout: 780 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.436177:0:18885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572459.436182:0:18885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572459.436193:0:18885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 11 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.436204:0:18885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 11 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.436281:0:18885:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 11 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.436298:0:18885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a49f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18885:1875453518434816:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788572459.436397:0:18885:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0520786c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788572459.436745:0:19589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e4dc56/0x977d9e7969c0186e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11686 expref: 11 pid: 19590 timeout: 780 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572459.436761:0:19589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19589:1875453518434688:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572459.436787:0:19589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 10 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572459.436798:0:19589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387600, rc 0) 00000100:00100000:1.0:1788572459.436828:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+10:18454:x1875453495398528:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 6137us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572459.436836:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:2.0:1788572459.443600:0:18885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a49f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18885:1875453518434816:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572459.443631:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572459.443691:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2356:x1875453495398656:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 7613us (7925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.443702:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788572459.445483:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.445583:0:19594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398784 00000100:00100000:3.0:1788572459.445614:0:19594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398784 00002000:00100000:3.0:1788572459.445681:0:19594:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x43:0x0] (0->1023) req@ffff88c0764a7100 x1875453495398784/t0(0) o4->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:120/0 lens 1512/0 e 0 to 0 dl 1788572470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572459.445693:0:19594:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c0764a7100 with x1875453495398784 ext(0->1023) 00002000:00010000:3.0:1788572459.445699:0:19594:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c0764a7100 00000100:00100000:3.0:1788572459.445752:0:19594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572459.445765:0:19594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+9:2356:x1875453495398784:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788572459.446292:0:19594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+11:2356:x1875453495398784:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 485us (772us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788572459.446300:0:19594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00002000:00100000:3.0:1788572459.446307:0:19594:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x43:0x0] (0->1023) req@ffff88c0764a7100 x1875453495398784/t12884901894(0) o4->2e29ee59-1edd-4938-bd41-1bf1d77c561a@192.168.202.2@tcp:120/0 lens 1512/448 e 0 to 0 dl 1788572470 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572459.446317:0:19594:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c0764a7100 with x1875453495398784 ext(0->1023) 00002000:00010000:3.0:1788572459.446320:0:19594:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c0764a7100 00000100:00100000:0.0:1788572459.449843:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.450010:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495398912 00000100:00100000:2.0:1788572459.450020:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495398912 00000100:00100000:2.0:1788572459.450093:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:2.0:1788572459.450104:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+42:18454:x1875453495398912:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788572459.538804:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+42:18454:x1875453495398912:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 88690us (88960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.538817:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000001:00080000:1.0:1788572459.539180:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901980 is committed 00000020:00080000:1.0:1788572459.539193:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0475716c0 refcount 2 committed 0 result 0 batchid 8589934642 00000020:00080000:1.0:1788572459.539197:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07669a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c050342000 00000020:00080000:1.0:1788572459.539200:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07669ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c06c97b800 00000001:00080000:1.0:1788572459.539240:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901982 is committed 00000020:00080000:1.0:1788572459.539277:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c076587600 refcount 2 committed 0 result 0 batchid 8589934641 00000020:00080000:1.0:1788572459.539294:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c05266f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c050342600 00000020:00080000:1.0:1788572459.539297:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c05266f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c049ad0c00 00000001:00080000:1.0:1788572459.539308:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901983 is committed 00000004:00080000:1.0:1788572459.539312:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788572459.539341:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901984 is committed 00000100:00100000:1.0:1788572459.539703:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572459.539721:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518434944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788572459.540654:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572459.540824:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518434944 00000100:00100000:0.0:1788572459.540832:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518434944 00000100:00100000:0.0:1788572459.540893:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572459.540903:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518434944:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788572459.541861:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934642 committed batchid 8589934640 00002000:00010000:0.0:1788572459.542264:0:19591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788572459.542269:0:19591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1788572459 00002000:00010000:0.0:1788572459.542272:0:19591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788572459.542274:0:19591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb ctime from disk: 1788572459 -> 1788572459 00002000:00010000:0.0:1788572459.542277:0:19591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788572459.542359:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1875453518434944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1456us (1705us total) trans 12884901895 rc 0/0 00000020:00080000:3.0:1788572459.542484:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934640 00000004:00080000:2.0:1788572459.542592:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bf476b8700/2, rc 0, transno 12884901895 00000100:00100000:2.0:1788572459.542598:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518434944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788572459.543461:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788572459.543664:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.543752:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495399040 00000100:00100000:2.0:1788572459.543761:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495399040 00000100:00100000:2.0:1788572459.543812:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788572459.543822:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+11:2355:x1875453495399040:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788572459.600205:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+11:2355:x1875453495399040:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 56373us (56533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.600218:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000001:00080000:1.0:1788572459.601231:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1788572459.601280:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00080000:1.0:1788572459.601295:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:1.0:1788572459.601299:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:0.0:1788572459.607039:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.607368:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495399296 00000100:00100000:2.0:1788572459.607382:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495399296 00000100:00100000:2.0:1788572459.607456:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:2.0:1788572459.607469:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18454:x1875453495399296:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572459.607540:0:18900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572459.607582:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969c01867 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1167f expref: 18 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.607623:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:2.0:1788572459.607628:0:18900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572459.607660:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.607674:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.607684:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572459.607883:0:18900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0bca2ac reply state 00000000b0996d61 transno 12884901985 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572459.607892:0:18900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572459.607994:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:18454:x1875453495399296:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 526us (969us total) trans 12884901985 rc 0/0 00000100:00100000:2.0:1788572459.608002:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00010000:00010000:0.0:1788572459.613867:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.613889:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.613897:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.613904:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572459.613909:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.613918:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.613938:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:0.0:1788572459.613941:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572459.613946:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.613953:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c0187c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572459.615774:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572459.615953:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495399424 00000100:00100000:1.0:1788572459.615966:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495399424 00000100:00100000:1.0:1788572459.616035:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1788572459.616049:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2356:x1875453495399424:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788572459.616425:0:19590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:1.0:1788572459.616430:0:19590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb mtime from disk: 1788572459 -> 1788572456 00002000:00010000:1.0:1788572459.616433:0:19590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb atime from disk: 0 -> 1788572458 00002000:00010000:1.0:1788572459.616435:0:19590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb ctime from disk: 1788572459 -> 1788572456 00002000:00010000:1.0:1788572459.616438:0:19590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788572459.616511:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495399424:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 464us (747us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788572459.616519:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1788572459.620980:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.621861:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495399680 00000100:00100000:3.0:1788572459.621873:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495399680 00000100:00100000:3.0:1788572459.621938:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:3.0:1788572459.621962:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:18454:x1875453495399680:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788572459.622034:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.622545:0:18901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.622558:0:18901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.622597:0:18901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.622612:0:18901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 18 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.622627:0:18901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518435072:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572459.622721:0:18901:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572459.636933:0:18901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18901:1875453518435072:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572459.636968:0:18901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572459.637976:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.638286:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495399808 00000100:00100000:3.0:1788572459.638295:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495399808 00010000:00010000:3.0:1788572459.638347:0:18887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.638486:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788572459.638510:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:2356:x1875453495399808:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572459.638526:0:18887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572459.638535:0:18887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.638549:0:18887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.638585:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c0184b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11671 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.638602:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:3.0:1788572459.638607:0:18887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.638617:0:18887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.638625:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.638660:0:18887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572459.638776:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:2356:x1875453495399808:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 268us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.638785:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00010000:00010000:0.0:1788572459.638896:0:18901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638905:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638945:0:18901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638953:0:18901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638959:0:18901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638966:0:18901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572459.638971:0:18901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638978:0:18901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638987:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:0.0:1788572459.638990:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788572459.638994:0:18901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.638999:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918a00/0x977d9e7969c01883 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572459.639059:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+17:18454:x1875453495399680:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 17091us (18079us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788572459.639067:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:1.0:1788572459.643089:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.643188:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495399936 00000100:00100000:0.0:1788572459.643199:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495399936 00000100:00100000:0.0:1788572459.643295:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788572459.643315:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2356:x1875453495399936:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788572459.643380:0:19589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.643402:0:19589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 7 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.643411:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572459.643416:0:19589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572459.643421:0:19589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.643457:0:19589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 7 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.643473:0:19589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 7 pid: 19589 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572459.643488:0:19589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19589:1875453518435200:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572459.643590:0:19589:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c3739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572459.648298:0:19589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19589:1875453518435200:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572459.648341:0:19589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572459.650984:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.651516:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495400064 00000100:00100000:2.0:1788572459.651527:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495400064 00010000:00010000:2.0:1788572459.651583:0:18885:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 8 pid: 19589 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572459.651630:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788572459.651641:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+8:2355:x1875453495400064:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572459.651657:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572459.651723:0:18885:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 8 pid: 19589 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.651751:0:18885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 8 pid: 19589 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.651777:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1869a67/0x977d9e7969c01875 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1168d expref: 8 pid: 19589 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.651795:0:18885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572459.651801:0:18885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572459.651807:0:18885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.651817:0:18885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.651860:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572459.651931:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+7:2355:x1875453495400064:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 291us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.651939:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00010000:00010000:0.0:1788572459.652364:0:19589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652394:0:19589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652422:0:19589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652431:0:19589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652440:0:19589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652446:0:19589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572459.652451:0:19589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652460:0:19589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652473:0:19589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.652482:0:19589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514bae58/0x977d9e7969c0188a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572459.652560:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2356:x1875453495399936:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 9246us (9480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.652569:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1788572459.658548:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.658710:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495400320 00000100:00100000:3.0:1788572459.658721:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495400320 00000100:00100000:3.0:1788572459.658891:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:3.0:1788572459.658902:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+17:18454:x1875453495400320:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788572459.658994:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659012:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659024:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659295:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659308:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659316:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659361:0:18902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 18 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.659385:0:18902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 18 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.659399:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518435328:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572459.659490:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572459.662971:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518435328:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572459.663006:0:18902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572459.663781:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.664036:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495400448 00000100:00100000:3.0:1788572459.664047:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495400448 00010000:00010000:3.0:1788572459.664097:0:18887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.664144:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1788572459.664154:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:2355:x1875453495400448:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572459.664169:0:18887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572459.664176:0:18887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664189:0:18887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664211:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386c00/0x977d9e7969c01859 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11678 expref: 19 pid: 18902 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664230:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:3.0:1788572459.664235:0:18887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664245:0:18887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664296:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664322:0:18887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572459.664396:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+18:2355:x1875453495400448:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 242us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.664404:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00010000:00010000:3.0:1788572459.664430:0:18902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.664437:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572459.665384:0:18902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901986 00000001:00080000:3.0:1788572459.666710:0:18902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901987 00000001:00080000:3.0:1788572459.666923:0:18902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901988 00000100:00100000:3.0:1788572459.667023:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18902:1875453518435456:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788572459.667699:0:18902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572459.667863:0:18906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518435456 00000100:00100000:0.0:1788572459.667874:0:18906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518435456 00000100:00100000:0.0:1788572459.667955:0:18906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572459.667967:0:18906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18902:x1875453518435456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788572459.668078:0:18906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18902:x1875453518435456:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.668087:0:18906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572459.668474:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572459.668506:0:18902:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901895 gen 2 00000004:00080000:3.0:1788572459.668512:0:18902:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901891 committed transno 12884901895 00000004:00080000:3.0:1788572459.668536:0:18902:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c07fd12680, transno 12884901892 00000004:00080000:3.0:1788572459.668551:0:18902:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bf476b8700, transno 12884901895 00000100:00100000:3.0:1788572459.668689:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18902:1875453518435456:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788572459.670968:0:18902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901989 00000100:00100000:3.0:1788572459.671234:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18902:1875453518435584:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788572459.671326:0:18902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572459.671496:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572459.671649:0:18906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518435584 00000100:00100000:0.0:1788572459.671658:0:18906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518435584 00000100:00100000:0.0:1788572459.671828:0:18906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788572459.671838:0:18906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18902:x1875453518435584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788572459.672073:0:18906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18902:x1875453518435584:12345-0@lo:1000:mdt00_002.0 Request processed in 236us (745us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788572459.672083:0:18906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788572459.672169:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18902:1875453518435584:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788572459.672321:0:18902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901990 00010000:00010000:3.0:1788572459.672369:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672410:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672418:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672424:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572459.672429:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672437:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672454:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c058907400) 00010000:00010000:3.0:1788572459.672457:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572459.672462:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672468:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c01898 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672499:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672506:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672511:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672516:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572459.672528:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672535:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672544:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572459.672546:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572459.672553:0:18902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 22 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672577:0:18902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 22 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672587:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 22 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.672620:0:18902:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 22 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.672634:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a48380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518435712:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788572459.672701:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572459.676319:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.676368:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495400576 00000100:00100000:3.0:1788572459.676387:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495400576 00000100:00100000:3.0:1788572459.676452:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1788572459.676463:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18453:x1875453495400576:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:3.0:1788572459.676617:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+23:18453:x1875453495400576:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 156us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.676647:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788572459.677283:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a48380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518435712:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572459.677312:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677323:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969c017e9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677436:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677453:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677465:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677475:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677481:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677488:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677493:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572459.677497:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677504:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677516:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572459.677519:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572459.677523:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677528:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c0189f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677548:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677553:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677558:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677563:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572459.677638:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677646:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677654:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572459.677657:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572459.677659:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.677665:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919400/0x977d9e7969c01891 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572459.678548:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788572459.678567:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572459.678618:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 4 00000040:00080000:0.0:1788572459.678623:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788572459.678807:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18454:x1875453495400320:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 19903us (20266us total) trans 12884901991 rc 0/0 00000100:00100000:2.0:1788572459.678819:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00000020:00080000:2.0:1788572459.678825:0:18902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1788572459.682098:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.682513:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495400832 00000100:00100000:0.0:1788572459.682525:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495400832 00000100:00100000:0.0:1788572459.682601:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:0.0:1788572459.682612:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18453:x1875453495400832:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:0.0:1788572459.683033:0:18901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].4, 136 off8736 00000100:00100000:0.0:1788572459.683118:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18453:x1875453495400832:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 505us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572459.683126:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:1.0:1788572459.689933:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.692240:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401088 00000100:00100000:3.0:1788572459.692276:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401088 00000100:00100000:3.0:1788572459.692356:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788572459.692370:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+22:18454:x1875453495401088:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788572459.696518:0:18904:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788572459.696924:0:18904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901992 00010000:00010000:2.0:1788572459.697016:0:18904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.697034:0:18904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.697046:0:18904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.697054:0:18904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.697060:0:18904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.697066:0:18904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.697086:0:18904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572459.697340:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+24:18454:x1875453495401088:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 4958us (7402us total) trans 12884901993 rc 0/0 00000100:00100000:2.0:1788572459.697352:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000020:00080000:2.0:1788572459.697358:0:18904:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572459.697692:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572459.697702:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.697709:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572459.697713:0:19971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.697723:0:19971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.697748:0:19971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:0.0:1788572459.697751:0:19971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572459.697756:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.697763:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018a6 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572459.697784:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572459.697786:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572459.697787:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572459.713542:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.713631:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401216 00000100:00100000:2.0:1788572459.713640:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401216 00000100:00100000:2.0:1788572459.713689:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:2.0:1788572459.713696:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+24:18456:x1875453495401216:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572459.713719:0:18902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572459.713738:0:18902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c018ad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11694 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.713813:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.713824:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.713833:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.713844:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.713848:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.713852:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.714072:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.714083:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 25 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.714091:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.714127:0:18902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 25 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.714153:0:18902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 25 pid: 18901 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572459.714170:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518435840:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572459.714298:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572459.717168:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18902:1875453518435840:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572459.717203:0:18902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572459.717770:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572459.717845:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401472 00000100:00100000:0.0:1788572459.717852:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401472 00000100:00100000:0.0:1788572459.717897:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1788572459.717904:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:16838:x1875453495401472:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788572459.718125:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:16838:x1875453495401472:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 219us (356us total) trans 12884901994 rc 0/0 00000100:00100000:0.0:1788572459.718143:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788572459.719937:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572459.720142:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401600 00000100:00100000:3.0:1788572459.720151:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401600 00010000:00010000:3.0:1788572459.720185:0:18886:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 27 pid: 18901 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572459.720292:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1788572459.720300:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:2355:x1875453495401600:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572459.720315:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572459.720321:0:18886:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 27 pid: 18901 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.720341:0:18886:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 27 pid: 18901 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.720371:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c017db lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11655 expref: 27 pid: 18901 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.720501:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572459.720507:0:18886:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.720516:0:18886:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.720522:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572459.720578:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572459.720613:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+26:2355:x1875453495401600:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 313us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.720617:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00010000:00010000:2.0:1788572459.720983:0:18902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.720992:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572459.721038:0:18902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00000004:00200000:2.0:1788572459.721045:0:18902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572459.721069:0:18902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721082:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721092:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721099:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721106:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721113:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572459.721125:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721133:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721144:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:2.0:1788572459.721147:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572459.721152:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721159:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c018b4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721171:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721178:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721184:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721188:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572459.721191:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721198:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721205:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff88c0593ef600) 00010000:00010000:2.0:1788572459.721207:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572459.721217:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721222:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c018bb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721357:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c018ad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11694 expref: 26 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721373:0:18902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11694 expref: 25 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572459.721439:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572459.721442:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572459.721444:0:18902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0dc00, rc 0) 00000100:00100000:2.0:1788572459.721532:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:18456:x1875453495401216:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 7834us (8000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.721540:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:2.0:1788572459.864667:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.864710:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.864740:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401984 00000100:00100000:2.0:1788572459.864754:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401984 00000100:00100000:2.0:1788572459.864822:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788572459.864833:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2353:x1875453495401984:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572459.864908:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2353:x1875453495401984:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.864916:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00080000:2.0:1788572459.864940:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572459.864988:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572459.865092:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401856 00000100:00100000:2.0:1788572459.865096:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401856 00000100:00100000:2.0:1788572459.865124:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788572459.865130:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2353:x1875453495401856:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572459.865162:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+6:2353:x1875453495401856:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.865168:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1788572459.865275:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495401728 00000100:00100000:3.0:1788572459.865280:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495401728 00000100:00100000:3.0:1788572459.865316:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:3.0:1788572459.865323:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8c1434-73ad-4808-be79-cf461833332c+13:2353:x1875453495401728:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572459.865365:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8c1434-73ad-4808-be79-cf461833332c+13:2353:x1875453495401728:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 43us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572459.865372:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00010000:00010000:2.0:1788572460.335343:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572460.701173:0:21801:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788572460.701180:0:21801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572460.701226:0:21801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:2.0:1788572460.701231:0:21801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:0.0:1788572460.713618:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788572460.713628:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572460.713660:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:0.0:1788572460.713666:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788572460.713789:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18933:1875453518435968:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788572460.713894:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c373780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572460.719631:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18933:1875453518435968:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788572460.721723:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572460.721820:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495402112 00000100:00100000:2.0:1788572460.721831:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495402112 00000100:00100000:2.0:1788572460.721970:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:2.0:1788572460.721980:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:18467:x1875453495402112:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788572460.722016:0:18902:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788572460.722117:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:18467:x1875453495402112:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 139us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572460.722126:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00080000:3.0:1788572460.722161:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572460.727137:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572460.728166:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495402368 00000100:00100000:1.0:1788572460.728181:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495402368 00000100:00100000:1.0:1788572460.728273:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:1.0:1788572460.728284:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+25:18467:x1875453495402368:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572460.728304:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572460.728326:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c018c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1169b expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572460.728447:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c018d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572460.728463:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c018d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572460.728475:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c018d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572460.728487:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1788572460.728616:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386e00/0x977d9e7969c018c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1169b expref: 28 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572460.728633:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c018d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1169b expref: 27 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572460.728654:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:1.0:1788572460.728657:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572460.728661:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:1.0:1788572460.728720:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:18467:x1875453495402368:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 439us (1591us total) trans 12884901995 rc 0/0 00000100:00100000:1.0:1788572460.728727:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:3.0:1788572460.732798:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572460.732847:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572460.732883:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495402752 00000100:00100000:3.0:1788572460.732893:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495402752 00000100:00100000:3.0:1788572460.732967:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:3.0:1788572460.732976:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:18467:x1875453495402752:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788572460.733057:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733075:0:18902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733087:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733311:0:18902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733319:0:18902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733326:0:18902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733332:0:18902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572460.733350:0:18902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733357:0:18902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733370:0:18902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572460.733373:0:18902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572460.733378:0:18902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572460.733407:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919600/0x977d9e7969c018de lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572460.733565:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:18467:x1875453495402752:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 588us (715us total) trans 12884901996 rc 0/0 00000100:00100000:3.0:1788572460.733575:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00000040:00080000:3.0:1788572460.733741:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788572460.733746:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572460.734228:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 5 00000040:00080000:3.0:1788572460.734236:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788572460.735650:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495402496 00000100:00100000:1.0:1788572460.735664:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495402496 00000100:00100000:1.0:1788572460.735741:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572460.735752:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4665c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:2356:x1875453495402496:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572460.735767:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572460.735790:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c018d0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1169b expref: 28 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572460.735811:0:18885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:1.0:1788572460.735816:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572460.735873:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4665c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:2356:x1875453495402496:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 123us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572460.735881:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572460.746895:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572460.747010:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403008 00000100:00100000:2.0:1788572460.747022:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403008 00000100:00100000:2.0:1788572460.747087:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:2.0:1788572460.747098:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07d674c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+27:18467:x1875453495403008:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788572460.747394:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07d674c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:18467:x1875453495403008:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 296us (507us total) trans 12884901997 rc 0/0 00000100:00100000:2.0:1788572460.747420:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00010000:00010000:3.0:1788572461.353605:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572462.184505:0:18925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682975253268ns, next at 683975250635ns, rc = 0 00000100:00100000:1.0:1788572462.184574:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518436096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572462.184648:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.184757:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436096 00000100:00100000:3.0:1788572462.184765:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436096 00000100:00100000:3.0:1788572462.184839:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572462.184850:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518436096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572462.184888:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788572462.184940:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518436096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.184948:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572462.184996:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518436096:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788572462.185070:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572462.196524:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518436352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.196593:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.196639:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572462.196644:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518436224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.196679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.196697:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518436736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.196717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.196744:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436352 00000100:00100000:3.0:1788572462.196750:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436352 00000100:00100000:3.0:1788572462.196803:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572462.196812:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.196858:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518436352:12345-0@lo:400:kworker.0 Request processed in 47us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.196864:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572462.196883:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436224 00000100:00100000:3.0:1788572462.196886:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436224 00000100:00100000:3.0:1788572462.196905:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788572462.196910:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3300:x1875453518436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.196932:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3300:x1875453518436224:12345-0@lo:400:kworker.0 Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.196937:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788572462.196960:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436736 00000100:00100000:3.0:1788572462.196963:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436736 00000100:00100000:3.0:1788572462.196985:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788572462.196990:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518436736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197013:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518436736:12345-0@lo:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.197019:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788572462.197040:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572462.197044:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572462.197360:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518436608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.197480:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572462.197485:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518436480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.197527:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436608 00000100:00100000:3.0:1788572462.197530:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436608 00000100:00100000:3.0:1788572462.197553:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436480 00000100:00100000:3.0:1788572462.197555:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436480 00000100:00100000:3.0:1788572462.197566:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788572462.197571:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518436608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197602:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518436608:12345-0@lo:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.197607:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788572462.197617:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788572462.197623:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197642:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518436480:12345-0@lo:400:kworker.0 Request processed in 20us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.197648:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788572462.197659:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572462.197685:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518436224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197696:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518436736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197705:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518436352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197731:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518436480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.197738:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518436608:0@lo:400:kworker.0 00010000:00010000:0.0:1788572462.377779:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572462.697405:0:21852:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788572462.697416:0:21852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572462.697463:0:21852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:1.0:1788572462.697476:0:21852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788572462.859047:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572462.859138:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403264 00000100:00100000:0.0:1788572462.859148:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403264 00000100:00100000:0.0:1788572462.859221:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:0.0:1788572462.859232:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+28:18485:x1875453495403264:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572462.859278:0:18901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572462.859301:0:18901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c018e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb116a2 expref: -99 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572462.859427:0:18901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c018ec lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572462.859443:0:18901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c018ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572462.859455:0:18901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c018ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572462.859479:0:18901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 16384 00010000:00010000:0.0:1788572462.859611:0:18901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91600/0x977d9e7969c018e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116a2 expref: 31 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572462.859631:0:18901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c018ec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116a2 expref: 30 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572462.859640:0:18901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:0.0:1788572462.859643:0:18901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572462.859646:0:18901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90600, rc 0) 00000100:00100000:0.0:1788572462.859705:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+30:18485:x1875453495403264:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 474us (669us total) trans 12884901998 rc 0/0 00000100:00100000:0.0:1788572462.859713:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00080000:3.0:1788572462.860108:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788572463.293017:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901906 is committed 00000001:00080000:2.0:1788572463.293037:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901905 is committed 00000001:00080000:2.0:1788572463.293044:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901907 is committed 00010000:00010000:2.0:1788572463.400430:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572464.232515:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518436864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572464.232589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572464.232655:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436864 00000100:00100000:1.0:1788572464.232664:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436864 00000100:00080000:3.0:1788572464.232698:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572464.232737:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572464.232744:0:19593:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788572464.232749:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518436864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572464.232753:0:19593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788572464.232790:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572464.232847:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518436864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572464.232854:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788572464.233882:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518436864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572464.426543:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572464.831453:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901998 is committed 00000004:00080000:2.0:1788572464.831488:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788572464.831511:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c052a4a300 refcount 2 committed 0 result 0 batchid 8589934643 00000020:00080000:2.0:1788572464.831516:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07fb76300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c052a4ab40 00000020:00080000:2.0:1788572464.831520:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07fb76a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88bf46e90000 00000020:00080000:2.0:1788572464.831535:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934642 batchid updated 00000020:00080000:3.0:1788572464.831858:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934643 committed batchid 8589934642 00000020:00080000:3.0:1788572464.832092:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934642 00000100:00100000:3.0:1788572464.832104:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572464.832124:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518436992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572464.832187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572464.832280:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518436992 00000100:00100000:3.0:1788572464.832288:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518436992 00000100:00100000:3.0:1788572464.832343:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788572464.832353:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518436992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572464.832394:0:19590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:67 count 1 00002000:00010000:3.0:1788572464.832431:0:19590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 1024, mtime: 0x6a9b7328, atime: 0x6a9b7327, ctime: 0x6a9b7328, blocks: 0xb 00010000:00010000:3.0:1788572464.832439:0:19590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572464.832457:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788572464.832462:0:19590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572464.832470:0:19590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572464.832487:0:19590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572464.832505:0:19590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572464.832514:0:19590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572464.832528:0:19590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572464.837241:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572464.837283:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572464.837297:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572464.837302:0:19971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572464.837314:0:19971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572464.837354:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572464.837383:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dfb78a8/0x977d9e7969c018fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572464.837406:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572464.837409:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572464.837411:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572464.838151:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518436992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5794us (5957us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788572464.838162:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788572464.838202:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572464.838878:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901907 gen 2 00000004:00080000:0.0:1788572464.838886:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901906 committed transno 12884901907 00000004:00080000:0.0:1788572464.838918:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901907 committed transno 12884901907 00000100:00100000:0.0:1788572464.838934:0:3298:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88bf4779d500 x1875453518436992/t12884901908(12884901908) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572480 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788572464.838948:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bf4779d500/2, rc 0, transno 12884901908 00000100:00100000:0.0:1788572464.838954:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518436992:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788572464.839690:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00000001:00080000:1.0:1788572464.840219:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00000100:00100000:3.0:1788572464.981990:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572464.982039:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572464.982131:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572464.982156:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572464.982197:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572464.982304:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403904 00000100:00100000:1.0:1788572464.982314:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403904 00000100:00100000:1.0:1788572464.982412:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403520 00000100:00100000:1.0:1788572464.982416:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403520 00000100:00100000:1.0:1788572464.982438:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788572464.982446:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2355:x1875453495403904:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572464.982519:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2355:x1875453495403904:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572464.982527:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788572464.982544:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:1.0:1788572464.982551:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:2355:x1875453495403520:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572464.982583:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:2355:x1875453495403520:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572464.982602:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00080000:1.0:1788572464.982634:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572464.984564:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403392 00000100:00100000:2.0:1788572464.984580:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403392 00000100:00100000:2.0:1788572464.984682:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:2.0:1788572464.984693:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8c1434-73ad-4808-be79-cf461833332c+13:2355:x1875453495403392:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572464.984775:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8c1434-73ad-4808-be79-cf461833332c+13:2355:x1875453495403392:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572464.984782:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1788572464.993082:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403648 00000100:00100000:0.0:1788572464.993097:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403648 00000100:00100000:0.0:1788572464.993240:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495403776 00000100:00100000:0.0:1788572464.993244:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495403776 00000100:00100000:3.0:1788572464.993317:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788572464.993329:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495403648:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572464.993425:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495403648:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 98us (11385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572464.993433:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00080000:1.0:1788572465.000994:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572465.001023:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572465.002177:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788572465.002193:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495403776:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572465.002289:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2355:x1875453495403776:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 99us (20091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572465.002297:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00010000:00010000:2.0:1788572465.448478:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.473486:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572467.304471:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518437248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.304574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.304632:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518437760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.304658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.304685:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572467.304691:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518437376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.304713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.304754:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437248 00000100:00100000:1.0:1788572467.304761:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437248 00000100:00100000:1.0:1788572467.304811:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437376 00000100:00100000:1.0:1788572467.304815:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437376 00000100:00100000:1.0:1788572467.304833:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572467.304841:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.304886:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518437248:12345-0@lo:400:kworker.0 Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.304892:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572467.304907:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788572467.304912:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518437376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.304933:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518437376:12345-0@lo:400:kworker.0 Request processed in 21us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.304938:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788572467.304953:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437760 00000100:00100000:1.0:1788572467.304956:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437760 00000100:00100000:1.0:1788572467.304979:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572467.304985:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518437760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305010:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518437760:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.305024:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788572467.305043:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572467.305047:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572467.305050:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572467.305083:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518437376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305090:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901897 gen 2 00000004:00080000:1.0:1788572467.305095:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901897 committed transno 12884901897 00000100:00100000:1.0:1788572467.305112:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518437248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305120:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518437760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.305356:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518437120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.305406:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.305447:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518437632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.305470:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.305485:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572467.305489:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518437504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.305505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.305524:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437120 00000100:00100000:3.0:1788572467.305527:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437120 00000100:00100000:3.0:1788572467.305552:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788572467.305557:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3298:x1875453518437120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.305587:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3298:x1875453518437120:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572467.305593:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788572467.305637:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518437120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305824:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437632 00000100:00100000:1.0:1788572467.305828:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437632 00000100:00100000:1.0:1788572467.305854:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437504 00000100:00100000:1.0:1788572467.305857:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437504 00000100:00100000:1.0:1788572467.305869:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788572467.305875:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518437632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305912:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518437632:12345-0@lo:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.305918:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788572467.305929:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788572467.305935:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518437504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305961:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518437504:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.305967:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788572467.305989:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518437504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.305997:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518437632:0@lo:400:kworker.0 00000100:00080000:1.0:1788572467.306024:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572467.306033:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572467.306040:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518437888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572467.306066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.306091:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518437888 00000100:00100000:1.0:1788572467.306095:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518437888 00000100:00100000:1.0:1788572467.310704:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572467.310737:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518437888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572467.310781:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788572467.310877:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518437888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.310884:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572467.310965:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518437888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572467.498433:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572468.372717:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901908 is committed 00000100:00100000:0.0:1788572468.479566:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572468.479665:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404032 00000100:00100000:1.0:1788572468.479677:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404032 00000100:00100000:1.0:1788572468.479754:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:1.0:1788572468.479765:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18308:x1875453495404032:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788572468.479881:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18308:x1875453495404032:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 117us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572468.479888:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00080000:2.0:1788572468.480352:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572468.491542:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572468.494343:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404288 00000100:00100000:2.0:1788572468.494363:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404288 00000100:00100000:2.0:1788572468.494456:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788572468.494469:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:18308:x1875453495404288:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788572468.494766:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+17:18308:x1875453495404288:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 299us (3236us total) trans 12884901999 rc 0/0 00000100:00100000:2.0:1788572468.494775:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00010000:00010000:2.0:1788572468.520363:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572469.353559:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572469.353590:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572469.353700:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572469.353955:0:21886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438016 00000100:00100000:0.0:1788572469.353963:0:21886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438016 00000100:00100000:0.0:1788572469.354036:0:21886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572469.354046:0:21886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518438016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572469.354088:0:21886:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572469.354204:0:21886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572469.354211:0:21886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572469.354280:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518438016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572469.354572:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788572469.544905:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788572469.929762:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788572469.929771:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572469.929808:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:0.0:1788572469.929814:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:00080000:2.0:1788572469.974704:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901999 is committed 00000020:00080000:2.0:1788572469.974733:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934643 batchid updated 00000020:00080000:2.0:1788572469.974749:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934643 00000020:00080000:2.0:1788572469.974761:0:18939:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934643 00000100:00100000:0.0:1788572470.100441:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572470.100481:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572470.100507:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572470.100526:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572470.100547:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572470.100572:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404928 00000100:00100000:0.0:1788572470.100580:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404928 00000100:00100000:0.0:1788572470.100645:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404544 00000100:00100000:0.0:1788572470.100648:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404544 00000100:00100000:0.0:1788572470.100668:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788572470.100676:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2354:x1875453495404928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572470.100735:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2354:x1875453495404928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572470.100748:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788572470.100763:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1788572470.100767:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:2354:x1875453495404544:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572470.100788:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:2354:x1875453495404544:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572470.100791:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1788572470.100806:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404672 00000100:00100000:0.0:1788572470.100808:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404672 00000100:00100000:0.0:1788572470.100825:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404800 00000100:00100000:0.0:1788572470.100827:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404800 00000100:00100000:0.0:1788572470.100837:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788572470.100841:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2354:x1875453495404672:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572470.100856:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2354:x1875453495404672:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 15us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572470.100860:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788572470.100866:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:0.0:1788572470.100870:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2354:x1875453495404800:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572470.100882:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2354:x1875453495404800:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 13us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572470.100886:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00080000:0.0:1788572470.100895:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572470.100897:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572470.100899:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572470.101313:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495404416 00000100:00100000:3.0:1788572470.101319:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495404416 00000100:00100000:3.0:1788572470.101354:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:3.0:1788572470.101361:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8c1434-73ad-4808-be79-cf461833332c+13:2354:x1875453495404416:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572470.101413:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8c1434-73ad-4808-be79-cf461833332c+13:2354:x1875453495404416:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 51us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572470.101420:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000001:02000400:0.0:1788572470.388503:0:22057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1f: Test auto RW-PCC cache with non-root user ========================================================== 21:41:08 (1788572468) 00010000:00010000:0.0:1788572470.571037:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.593389:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572472.425212:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572472.425268:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518438144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572472.425361:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572472.425436:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438144 00000100:00100000:1.0:1788572472.425443:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438144 00000100:00100000:1.0:1788572472.425495:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788572472.425504:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518438144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572472.425539:0:19593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788572472.425582:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518438144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.425589:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788572472.425624:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901908 gen 2 00000004:00080000:1.0:1788572472.425630:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bf4779d500, transno 12884901908 00000100:00100000:1.0:1788572472.425645:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518438144:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572472.425959:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572472.426078:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518438400:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426114:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.426140:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572472.426147:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518438272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426188:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.426218:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518438784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.426288:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438400 00000100:00100000:0.0:1788572472.426293:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438400 00000100:00100000:0.0:1788572472.426329:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788572472.426337:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518438400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426394:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518438400:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.426411:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788572472.426433:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438784 00000100:00100000:0.0:1788572472.426437:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438784 00000100:00100000:0.0:1788572472.426466:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572472.426472:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518438784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426501:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518438784:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.426507:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572472.426528:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518438656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426552:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.426568:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572472.426583:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426621:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.426656:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438656 00000100:00100000:0.0:1788572472.426660:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438656 00000100:00100000:0.0:1788572472.426682:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438528 00000100:00100000:0.0:1788572472.426684:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438528 00000100:00100000:0.0:1788572472.426698:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572472.426704:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426738:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518438656:12345-0@lo:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.426744:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572472.426757:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572472.426762:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518438528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426787:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518438528:12345-0@lo:400:kworker.0 Request processed in 25us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.426791:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788572472.426807:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572472.426810:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572472.426834:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426844:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518438656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426868:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518438784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572472.426878:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518438400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.427134:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438272 00000100:00100000:3.0:1788572472.427141:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438272 00000100:00100000:3.0:1788572472.427179:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788572472.427187:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3300:x1875453518438272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.427229:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3300:x1875453518438272:12345-0@lo:400:kworker.0 Request processed in 44us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572472.427244:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788572472.435022:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518438272:0@lo:400:kworker.0 00010000:00010000:0.0:1788572472.618553:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572473.038292:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572473.038648:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495405056 00000100:00100000:2.0:1788572473.038659:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495405056 00000100:00100000:2.0:1788572473.038729:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:2.0:1788572473.038740:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:19120:x1875453495405056:12345-192.168.202.2@tcp:101:lsof.0 00010000:00010000:2.0:1788572473.038763:0:18900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572473.038786:0:18900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb116a9 expref: -99 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572473.038846:0:18900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01908 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572473.038860:0:18900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572473.038872:0:18900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572473.038905:0:18900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572473.038909:0:18900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572473.038956:0:18900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572473.038979:0:18900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116a9 expref: 7 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572473.038998:0:18900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116a9 expref: 6 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572473.039007:0:18900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:2.0:1788572473.039009:0:18900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572473.039013:0:18900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d000, rc 0) 00000100:00100000:2.0:1788572473.039079:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:19120:x1875453495405056:12345-192.168.202.2@tcp:101:lsof.0 Request processed in 340us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572473.039085:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00080000:0.0:1788572473.040515:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572473.640696:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572474.472621:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572474.472655:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518438912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572474.472746:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572474.472979:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518438912 00000100:00100000:3.0:1788572474.472987:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518438912 00000100:00100000:3.0:1788572474.473058:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572474.473068:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518438912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572474.473102:0:19592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572474.473147:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518438912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572474.473154:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788572474.473287:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572474.473729:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518438912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572474.664789:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572475.117985:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572475.119533:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495405312 00000100:00100000:0.0:1788572475.119545:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495405312 00000100:00100000:0.0:1788572475.119681:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788572475.119692:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+16:19121:x1875453495405312:12345-192.168.202.2@tcp:35:umount.0 00000001:00080000:0.0:1788572475.125084:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902000 00000001:00080000:0.0:1788572475.125164:0:18903:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902001 00000100:00100000:0.0:1788572475.125332:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:19121:x1875453495405312:12345-192.168.202.2@tcp:35:umount.0 Request processed in 5637us (7353us total) trans 12884902002 rc 0/0 00000100:00100000:0.0:1788572475.125343:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000020:00080000:0.0:1788572475.125349:0:18903:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1788572475.127203:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572475.128947:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572475.129043:0:18903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495405568 00000100:00100000:0.0:1788572475.129057:0:18903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495405568 00000100:00100000:0.0:1788572475.129144:0:18903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788572475.129154:0:18903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:19121:x1875453495405568:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:0.0:1788572475.130162:0:18903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:19121:x1875453495405568:12345-192.168.202.2@tcp:35:umount.0 Request processed in 1002us (1216us total) trans 12884902003 rc 0/0 00000100:00100000:0.0:1788572475.130173:0:18903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788572475.137295:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572475.137336:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572475.137362:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572475.137480:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495405696 00000100:00100000:2.0:1788572475.137490:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495405696 00000100:00100000:2.0:1788572475.137552:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495405952 00000100:00100000:2.0:1788572475.137556:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495405952 00000100:00100000:2.0:1788572475.137569:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495405824 00000100:00100000:2.0:1788572475.137572:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495405824 00000100:00100000:2.0:1788572475.137588:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788572475.137597:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+15:2353:x1875453495405696:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572475.137612:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572475.137631:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4d200/0x977d9e7969c010fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113d8 expref: 15 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572475.137681:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572475.137749:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+14:2353:x1875453495405696:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 152us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572475.137757:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788572475.137777:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788572475.137784:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+13:2353:x1875453495405952:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572475.137791:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572475.137800:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0c000/0x977d9e7969c01208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114b8 expref: 13 pid: 18894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572475.137808:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572475.137824:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+12:2353:x1875453495405952:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 41us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572475.137830:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788572475.137841:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788572475.137846:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+11:2353:x1875453495405824:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572475.137852:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572475.137859:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076995800/0x977d9e7969c01105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11402 expref: 11 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572475.137867:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572475.137880:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+10:2353:x1875453495405824:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 34us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572475.137885:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572475.144995:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572475.145097:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495406080 00000100:00100000:0.0:1788572475.145108:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495406080 00000100:00100000:0.0:1788572475.145202:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:0.0:1788572475.145213:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2352:x1875453495406080:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:0.0:1788572475.145309:0:19591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c01121 00000100:00080000:0.0:1788572475.145319:0:19591:0:(import.c:65:import_set_state_nolock()) ffff88c074c4d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572475.145358:0:19591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901908 00000100:00100000:0.0:1788572475.145636:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e29ee59-1edd-4938-bd41-1bf1d77c561a+2:2352:x1875453495406080:12345-192.168.202.2@tcp:9:umount.0 Request processed in 424us (654us total) trans 0 rc 0/0 00010000:00010000:3.0:1788572475.145790:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572475.146406:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572475.146637:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788572475.149386:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572475.149715:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495406208 00000100:00100000:0.0:1788572475.149726:0:19589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495406208 00000100:00100000:0.0:1788572475.149849:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1788572475.149859:0:19589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+5:2352:x1875453495406208:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:0.0:1788572475.149888:0:19589:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c014e0 00000100:00080000:0.0:1788572475.149897:0:19589:0:(import.c:65:import_set_state_nolock()) ffff88c07bd49800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572475.149948:0:19589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:0.0:1788572475.150226:0:19589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e29ee59-1edd-4938-bd41-1bf1d77c561a+2:2352:x1875453495406208:12345-192.168.202.2@tcp:9:umount.0 Request processed in 367us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572475.150234:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00010000:00010000:3.0:1788572475.150593:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572475.151066:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572475.156913:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572475.157022:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495407360 00000100:00100000:0.0:1788572475.157032:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495407360 00000100:00100000:0.0:1788572475.157094:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:0.0:1788572475.157104:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+20:2352:x1875453495407360:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:0.0:1788572475.157202:0:18901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c01113 00000020:00010000:0.0:1788572475.157220:0:18901:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c050278800: total 0 00000100:00080000:0.0:1788572475.157224:0:18901:0:(import.c:65:import_set_state_nolock()) ffff88c0513c0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572475.157339:0:18901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902003 00000100:00100000:0.0:1788572475.159429:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e29ee59-1edd-4938-bd41-1bf1d77c561a+19:2352:x1875453495407360:12345-192.168.202.2@tcp:39:umount.0 Request processed in 2299us (2501us total) trans 12884902004 rc 0/0 00000100:00100000:0.0:1788572475.159444:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000020:00010000:1.0:1788572475.166627:0:18888:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c050278800: total 0 00010000:00010000:1.0:1788572475.166709:0:18888:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c050278800, canceled 0 locks, left on hash table 11. 00010000:00010000:1.0:1788572475.166744:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff88c061a51d00) 00010000:00010000:1.0:1788572475.166748:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788572475.166760:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c919800/0x977d9e7969c0129b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114e9 expref: 18 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166863:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:1.0:1788572475.166867:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572475.166884:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c011b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1149c expref: 17 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166902:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:1.0:1788572475.166905:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572475.166908:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c018c2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11694 expref: 16 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166921:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:1.0:1788572475.166923:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572475.166927:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c01477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11567 expref: 15 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166937:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:1.0:1788572475.166940:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788572475.166943:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01397 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11536 expref: 14 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166957:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572475.166959:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788572475.166963:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995400/0x977d9e7969c014b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11575 expref: 13 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166975:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:1.0:1788572475.166977:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788572475.166981:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c06c918600/0x977d9e7969c01319 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11513 expref: 12 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.166991:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0593efd00) 00010000:00010000:1.0:1788572475.166998:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572475.167003:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c011d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114a3 expref: 11 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.167018:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:1.0:1788572475.167020:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572475.167024:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0133c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11521 expref: 10 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.167036:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff88c058eac200) 00010000:00010000:1.0:1788572475.167038:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788572475.167042:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969c018ec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116a2 expref: 9 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.167055:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:1.0:1788572475.167057:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572475.167060:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91c00/0x977d9e7969c017f0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1165c expref: 8 pid: 18901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572475.167072:0:18888:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c050278800, canceled 11 locks, left on hash table 0. 00010000:00010000:1.0:1788572475.167104:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572475.167106:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572475.167108:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572475.222387:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572475.222503:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495407488 00000100:00100000:0.0:1788572475.222514:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495407488 00000100:00100000:0.0:1788572475.222626:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1788572475.222639:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2354:x1875453495407488:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572475.222765:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2354:x1875453495407488:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572475.222773:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00080000:2.0:1788572475.223496:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788572475.688521:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572476.712914:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572477.544521:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572477.544549:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572477.544624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.544811:0:21886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439040 00000100:00100000:1.0:1788572477.544819:0:21886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439040 00000100:00100000:1.0:1788572477.544880:0:21886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788572477.544890:0:21886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518439040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572477.544929:0:21886:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788572477.544978:0:21886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518439040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.545001:0:21886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788572477.545070:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572477.545109:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572477.548012:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572477.548165:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518439296:0@lo:400:kworker.0 00000100:00100000:3.0:1788572477.548173:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572477.548202:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518439552:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.548237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572477.548237:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572477.552463:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3297:1875453518439168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.552539:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572477.552549:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439552 00000100:00100000:3.0:1788572477.552558:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439552 00000100:00100000:0.0:1788572477.552587:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439168 00000100:00100000:0.0:1788572477.552591:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439168 00000100:00100000:0.0:1788572477.552620:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788572477.552620:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788572477.552628:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3297:x1875453518439168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572477.552628:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518439552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572477.552680:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518439552:12345-0@lo:400:kworker.0 Request processed in 53us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572477.552688:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788572477.552714:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572477.552744:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.552753:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3297:x1875453518439168:12345-0@lo:400:kworker.0 Request processed in 127us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572477.552760:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788572477.552786:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518439424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.552793:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3297:1875453518439168:0@lo:400:kworker.0 00000100:00100000:3.0:1788572477.552812:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572477.552821:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439296 00000100:00100000:3.0:1788572477.552840:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439424 00000100:00100000:3.0:1788572477.552844:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439424 00000100:00100000:3.0:1788572477.552866:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788572477.552871:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518439424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.552897:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439296 00000100:00100000:3.0:1788572477.552905:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518439424:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572477.552911:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572477.552930:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572477.552934:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518439424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.552936:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518439296:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788572477.552946:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572477.553044:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518439296:12345-0@lo:400:kworker.0 Request processed in 108us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572477.553052:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788572477.553260:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518439296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.553573:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572477.553730:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518439680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.553763:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572477.553918:0:18902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439680 00000100:00100000:3.0:1788572477.553924:0:18902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439680 00000100:00100000:3.0:1788572477.554075:0:18902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788572477.554082:0:18902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572477.554166:0:18902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518439680:12345-0@lo:400:kworker.0 Request processed in 84us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572477.554173:0:18902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788572477.554311:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518439680:0@lo:400:kworker.0 00000100:00080000:0.0:1788572477.554523:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572477.737122:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572477.778333:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572477.778378:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572477.778413:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572477.778508:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495407616 00000100:00100000:2.0:1788572477.778518:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495407616 00000100:00100000:2.0:1788572477.778585:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495407872 00000100:00100000:2.0:1788572477.778588:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495407872 00000100:00100000:2.0:1788572477.778601:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495407744 00000100:00100000:2.0:1788572477.778603:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495407744 00000100:00100000:2.0:1788572477.778620:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788572477.778632:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+12:2353:x1875453495407616:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572477.778652:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572477.778686:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4d600/0x977d9e7969c01136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1143a expref: 12 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572477.778706:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572477.778775:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+11:2353:x1875453495407616:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 145us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.778784:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788572477.778804:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788572477.778810:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+10:2353:x1875453495407872:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572477.778817:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572477.778838:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb114b1 expref: 10 pid: 18894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572477.778847:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572477.778866:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+9:2353:x1875453495407872:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 56us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.778890:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788572477.778904:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572477.778910:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+8:2353:x1875453495407744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572477.778917:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572477.778926:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4d000/0x977d9e7969c0113d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11464 expref: 8 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572477.778933:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572477.778949:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8c1434-73ad-4808-be79-cf461833332c+7:2353:x1875453495407744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 40us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.778954:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788572477.801105:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572477.801291:0:18901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495408128 00000100:00100000:0.0:1788572477.801315:0:18901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495408128 00000100:00100000:0.0:1788572477.801403:0:18901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:0.0:1788572477.801414:0:18901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+6:2352:x1875453495408128:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:0.0:1788572477.801468:0:18901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c0114b 00000020:00010000:0.0:1788572477.801477:0:18901:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c052a5b000: total 0 00000100:00080000:0.0:1788572477.801481:0:18901:0:(import.c:65:import_set_state_nolock()) ffff88c052a5c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572477.801515:0:18901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902004 00000100:00100000:0.0:1788572477.801728:0:18901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc253da9-16dc-43a2-a270-63fc175cf1ea+5:2352:x1875453495408128:12345-192.168.202.2@tcp:39:umount.0 Request processed in 315us (634us total) trans 12884902005 rc 0/0 00000100:00100000:0.0:1788572477.801736:0:18901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 137 00000020:00010000:2.0:1788572477.802120:0:18889:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c052a5b000: total 0 00010000:00010000:2.0:1788572477.802166:0:18889:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c052a5b000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788572477.802198:0:18889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:2.0:1788572477.802202:0:18889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572477.802211:0:18889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c01908 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116a9 expref: 4 pid: 18900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572477.802237:0:18889:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c052a5b000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788572477.802308:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572477.802311:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572477.802313:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572477.802359:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572477.821598:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572477.825554:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495408384 00000100:00100000:0.0:1788572477.825570:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495408384 00000100:00100000:0.0:1788572477.825643:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:0.0:1788572477.825655:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8c1434-73ad-4808-be79-cf461833332c+7:2352:x1875453495408384:12345-192.168.202.2@tcp:251:umount.0 00000020:00000080:0.0:1788572477.825704:0:18895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c010f0 00000020:00010000:0.0:1788572477.825712:0:18895:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c05027f000: total 0 00000100:00080000:0.0:1788572477.825716:0:18895:0:(import.c:65:import_set_state_nolock()) ffff88c05027f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788572477.825802:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8c1434-73ad-4808-be79-cf461833332c+3:2352:x1875453495408384:12345-192.168.202.2@tcp:251:umount.0 Request processed in 148us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572477.825811:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 139 00000020:00010000:1.0:1788572477.826811:0:19971:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c05027f000: total 0 00010000:00010000:1.0:1788572477.826819:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572477.826879:0:19971:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c05027f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788572477.826916:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4de00/0x977d9e7969c010f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113d1 expref: 2 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572477.826932:0:19971:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c05027f000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788572477.826940:0:19971:0:(genops.c:885:class_export_put()) final put ffff88c05027f000/3f8c1434-73ad-4808-be79-cf461833332c 00010000:00010000:1.0:1788572477.826958:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572477.826960:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572477.826962:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572477.827140:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c05027f000/3f8c1434-73ad-4808-be79-cf461833332c for MGS 00000020:00000080:2.0:1788572477.827180:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c05027f800 for MGS 00000001:00100000:3.0:1788572478.657492:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:3.0:1788572478.657502:0:7635:0:(genops.c:885:class_export_put()) final put ffff88c074c49000/2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:3.0:1788572478.657535:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074c49000/2e29ee59-1edd-4938-bd41-1bf1d77c561a for lustre-OST0001 00000020:00000080:3.0:1788572478.657577:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c074c4d000 for lustre-OST0001 00010000:00010000:3.0:1788572478.762031:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572479.153093:0:18933:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788572479.153104:0:18933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572479.153156:0:18933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:1.0:1788572479.153166:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788572479.596334:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518439808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572479.596412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572479.596526:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439808 00000100:00100000:2.0:1788572479.596535:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439808 00000100:00100000:2.0:1788572479.596599:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788572479.596609:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518439808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572479.596646:0:19593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572479.596695:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518439808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572479.596702:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788572479.596848:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572479.596902:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518439808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572479.784362:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788572480.031063:0:22257:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788572480.043873:0:22257:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788572480.043932:0:22257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.043947:0:22257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.043955:0:22257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.043962:0:22257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.043992:0:22257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788572480.044000:0:22257:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788572480.044024:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572480.044029:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788572480.044036:0:22257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788572480.044078:0:22257:0:(import.c:65:import_set_state_nolock()) ffff88c0556c1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788572480.044169:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518439936:0@lo:39:umount.0 00000100:00100000:0.0:1788572480.044241:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572480.044373:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572480.044381:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.044389:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572480.044392:0:19971:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.044401:0:19971:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572480.044408:0:19971:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572480.044413:0:19971:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572480.044415:0:19971:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572480.044418:0:19971:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572480.044454:0:19971:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.044468:0:19971:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572480.044494:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.044501:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076995000/0x977d9e7969c00de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00dee expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.044512:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572480.044514:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572480.044515:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572480.044522:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572480.044533:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3299:1875453518440064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572480.044569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572480.044777:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440064 00000100:00100000:2.0:1788572480.044783:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440064 00000100:00100000:2.0:1788572480.044827:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572480.044837:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4665dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+19:3299:x1875453518440064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572480.044850:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572480.044864:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0c800/0x977d9e7969c00dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00de7 expref: 19 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.044877:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572480.044914:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4665dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+18:3299:x1875453518440064:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572480.044921:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572480.044986:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3299:1875453518440064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572480.045135:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518439936 00000100:00100000:3.0:1788572480.045140:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518439936 00000100:00100000:3.0:1788572480.045178:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788572480.045185:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875453518439936:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788572480.045208:0:18900:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00e18 00000100:00080000:3.0:1788572480.045217:0:18900:0:(import.c:65:import_set_state_nolock()) ffff88c076d0e800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788572480.045299:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3296:x1875453518439936:12345-0@lo:39:umount.0 Request processed in 114us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572480.045305:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000020:00000080:3.0:1788572480.045312:0:18900:0:(genops.c:885:class_export_put()) final put ffff88c07b5e9800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788572480.045333:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572480.045342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b5e9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572480.045389:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c076d0e800 for lustre-MDT0000 00000100:00080000:0.0:1788572480.045527:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0556c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572480.045543:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518439936:0@lo:39:umount.0 00000100:00080000:3.0:1788572480.045843:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572480.045847:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572480.045852:0:22257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572480.047171:0:22257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047188:0:22257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047196:0:22257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047203:0:22257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047335:0:22257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572480.047343:0:22257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047350:0:22257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047356:0:22257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.047362:0:22257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047640:0:18889:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572480.047654:0:18889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047661:0:18889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572480.047664:0:18889:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047738:0:18889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572480.047747:0:18889:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572480.047753:0:18889:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572480.047755:0:18889:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788572480.047791:0:18889:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047798:0:18889:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788572480.047856:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788572480.047873:0:18889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047881:0:18889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c00d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00d54 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047896:0:18889:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572480.047899:0:18889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047904:0:18889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572480.047906:0:18889:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047920:0:18889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572480.047925:0:18889:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572480.047930:0:18889:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572480.047932:0:18889:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788572480.047945:0:18889:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.047950:0:18889:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788572480.047980:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572480.047999:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3297:1875453518440320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572480.048072:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572480.048133:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440320 00000100:00100000:0.0:1788572480.048139:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440320 00000100:00100000:0.0:1788572480.048183:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788572480.048191:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+18:3297:x1875453518440320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572480.048202:0:18887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572480.048216:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4ce00/0x977d9e7969c01009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c01002 expref: 18 pid: 18894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.048231:0:18887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572480.048285:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+17:3297:x1875453518440320:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572480.048292:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788572480.048332:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3297:1875453518440320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572480.048432:0:22257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1788572480.048438:0:22257:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788572480.048457:0:22257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.048465:0:22257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.048471:0:22257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.048477:0:22257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572480.048527:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518440192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572480.048557:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572480.048731:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572480.048737:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.048744:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572480.048748:0:19971:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.048755:0:19971:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572480.048762:0:19971:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572480.048766:0:19971:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788572480.048774:0:19971:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788572480.048792:0:19971:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.048798:0:19971:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572480.048826:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.048834:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572480.048836:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572480.048837:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572480.048845:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572480.048855:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518440448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572480.048881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572480.048908:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440192 00000100:00100000:0.0:1788572480.048911:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440192 00000100:00100000:0.0:1788572480.048938:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440448 00000100:00100000:0.0:1788572480.048941:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440448 00000100:00100000:0.0:1788572480.048955:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572480.048962:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+18:3298:x1875453518440192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572480.048972:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572480.048982:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4da00/0x977d9e7969c00d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00d4d expref: 18 pid: 18894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.048991:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572480.049018:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+17:3298:x1875453518440192:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572480.049024:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572480.049036:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572480.049041:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+16:3300:x1875453518440448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572480.049054:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572480.049062:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024a000/0x977d9e7969c01198 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c01191 expref: 16 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.049070:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572480.049094:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+15:3300:x1875453518440448:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572480.049099:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572480.049126:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518440448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572480.049145:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3298:1875453518440192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572480.049272:0:18889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.049280:0:18889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c01002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c01009 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.049295:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572480.049296:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572480.049298:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572480.049451:0:22257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572480.049462:0:22257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c058a0cc00/0x977d9e7969c01191 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c01198 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572480.049472:0:22257:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788572480.049480:0:22257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.049486:0:22257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.049493:0:22257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572480.049499:0:22257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.049530:0:18888:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572480.049535:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.049542:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040031800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572480.049545:0:18888:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.049552:0:18888:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572480.049559:0:18888:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572480.049564:0:18888:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572480.049566:0:18888:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788572480.049643:0:18888:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.049660:0:18888:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788572480.049754:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518440576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572480.049783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572480.049837:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572480.049846:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572480.049847:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572480.049849:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572480.049887:0:18885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440576 00000100:00100000:2.0:1788572480.049891:0:18885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440576 00000100:00100000:2.0:1788572480.049930:0:18885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572480.049938:0:18885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+15:3300:x1875453518440576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572480.049946:0:18885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572480.049955:0:18885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c00d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00d3f expref: 15 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572480.049977:0:18885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572480.050015:0:22257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572480.050020:0:22257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969c00d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00d46 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572480.050031:0:22257:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788572480.050035:0:22257:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788572480.050039:0:22257:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788572480.050072:0:22257:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788572480.050076:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788572480.050080:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572480.050086:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1788572480.050091:0:22257:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88c074c48800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572480.050097:0:22257:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88c0503f5000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572480.050104:0:22257:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff88c052a5b000 fc253da9-16dc-43a2-a270-63fc175cf1ea 192.168.202.2@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 12884901895 stale:0 00000020:00080000:3.0:1788572480.050115:0:22257:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff88c050278800 2e29ee59-1edd-4938-bd41-1bf1d77c561a 192.168.202.2@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 12884901999 stale:0 00000020:00080000:3.0:1788572480.050120:0:22257:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff88bf46070000) has exports, disconnecting them 00000020:00080000:3.0:1788572480.050124:0:22257:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88c074c48800), last request at 1788572477 00000020:00000080:3.0:1788572480.050131:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00ff4 00000100:00080000:3.0:1788572480.050146:0:22257:0:(import.c:65:import_set_state_nolock()) ffff88c074c4f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572480.050191:0:22257:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c074c48800): rc 0 00000020:00000080:3.0:1788572480.050193:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c074c48800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788572480.050203:0:22257:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88c0503f5000), last request at 1788572477 00000020:00000080:3.0:1788572480.050206:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00e9d 00000100:00080000:3.0:1788572480.050211:0:22257:0:(import.c:65:import_set_state_nolock()) ffff88c0503f2800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788572480.050221:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074c48800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572480.050297:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c074c4f800 for lustre-MDT0000 00000020:00080000:3.0:1788572480.050313:0:22257:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c0503f5000): rc 0 00000020:00000080:3.0:1788572480.050316:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c0503f5000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788572480.050326:0:22257:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac68c1c77ae0 00000020:00000080:3.0:1788572480.050336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0503f5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572480.050358:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0503f2800 for lustre-MDT0000 00000100:00080000:3.0:1788572480.050380:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572480.050383:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901897 gen 3 00000004:00080000:3.0:1788572480.050396:0:22257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788572480.050464:0:22257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788572480.050478:0:22257:0:(import.c:65:import_set_state_nolock()) ffff88bf4531f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788572480.050488:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572480.050490:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901908 gen 3 00000004:00080000:3.0:1788572480.050500:0:22257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788572480.050552:0:22257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788572480.050560:0:22257:0:(import.c:65:import_set_state_nolock()) ffff88c074cb8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788572480.050680:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572480.050686:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788572480.050727:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88bf46070000) has no exports 00000100:00100000:2.0:1788572480.050887:0:18885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e+14:3300:x1875453518440576:12345-0@lo:103:ldlm_bl.0 Request processed in 949us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572480.050896:0:18885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788572480.051017:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572480.051072:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518440704:0@lo:9:umount.0 00000100:00100000:0.0:1788572480.051116:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572480.051156:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518440832:0@lo:9:umount.0 00000100:00100000:0.0:1788572480.051180:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572480.051215:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440704 00000100:00100000:0.0:1788572480.051221:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440704 00000100:00100000:0.0:1788572480.051312:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518440832 00000100:00100000:0.0:1788572480.051315:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518440832 00000100:00100000:0.0:1788572480.051348:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788572480.051355:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875453518440704:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788572480.051375:0:19969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00eb9 00000100:00080000:0.0:1788572480.051382:0:19969:0:(import.c:65:import_set_state_nolock()) ffff88c05027c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572480.051414:0:19969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:0.0:1788572480.051731:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3296:x1875453518440704:12345-0@lo:9:umount.0 Request processed in 314us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572480.051740:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788572480.051759:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572480.051766:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875453518440832:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788572480.051787:0:19969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c01010 00000100:00080000:0.0:1788572480.051792:0:19969:0:(import.c:65:import_set_state_nolock()) ffff88c05027d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572480.051811:0:19969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901908 00000100:00100000:0.0:1788572480.052059:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3296:x1875453518440832:12345-0@lo:9:umount.0 Request processed in 293us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572480.052066:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788572480.052085:0:18896:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572480.052095:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572480.052098:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572480.052120:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf4531f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788572480.052129:0:3296:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572480.052130:0:3296:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572480.052133:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518440704:0@lo:9:umount.0 00000100:00080000:0.0:1788572480.052142:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c074cb8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788572480.052145:0:3296:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572480.052147:0:3296:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572480.052149:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518440832:0@lo:9:umount.0 00000100:00100000:1.0:1788572480.052854:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518440576:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788572480.070921:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88bf46070000) has no exports 00000020:00000080:3.0:1788572480.146633:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d9a 00000020:00000080:3.0:1788572480.146651:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c0484ad000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788572480.146682:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788572480.146871:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0484ad000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788572480.147103:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572480.147114:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788572480.147118:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff88c058ee8000) has no exports 00000020:00000080:0.0:1788572480.150013:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d93 00000020:00000080:0.0:1788572480.150031:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c076d0f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572480.150050:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c076d0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572480.150099:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572480.150111:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788572480.150114:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c076d0c000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788572480.150116:0:22257:0:(genops.c:844:class_export_destroy()) destroying export ffff88c076d0c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788572480.150121:0:22257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1788572480.170778:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc253da9-16dc-43a2-a270-63fc175cf1ea 00000001:00080000:1.0:1788572480.170799:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902005 is committed 00000020:00000080:1.0:1788572480.170805:0:5853:0:(genops.c:885:class_export_put()) final put ffff88c052a5b000/fc253da9-16dc-43a2-a270-63fc175cf1ea 00000001:00100000:1.0:1788572480.170820:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000001:00080000:1.0:1788572480.170826:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902004 is committed 00000020:00000080:1.0:1788572480.170836:0:5853:0:(genops.c:885:class_export_put()) final put ffff88c050278800/2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:1.0:1788572480.170973:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c052a5b000/fc253da9-16dc-43a2-a270-63fc175cf1ea for lustre-MDT0000 00000020:00000080:1.0:1788572480.171029:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c050278800/2e29ee59-1edd-4938-bd41-1bf1d77c561a for lustre-MDT0000 00000020:00000080:1.0:1788572480.171055:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c052a5c800 for lustre-MDT0000 00000020:00000080:1.0:1788572480.171062:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0513c0000 for lustre-MDT0000 00000001:00100000:1.0:1788572480.204590:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572480.204601:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c05027a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788572480.204623:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:1.0:1788572480.204625:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c07bd4a000/2e29ee59-1edd-4938-bd41-1bf1d77c561a 00000020:00000080:1.0:1788572480.204644:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c05027a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788572480.204834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07bd4a000/2e29ee59-1edd-4938-bd41-1bf1d77c561a for lustre-OST0000 00000020:00000080:1.0:1788572480.204855:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c05027c000 for lustre-OST0000 00000020:00000080:1.0:1788572480.204860:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c07bd49800 for lustre-OST0000 00010000:00010000:2.0:1788572480.808423:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572481.835298:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788572482.152605:0:22257:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0599519c0 - data ffff88c070444e58/ffff88bf461db000 00000020:01000000:0.0:1788572482.152785:0:22257:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c07ba9af00 - data ffff88c04a83f438/ffff88c06c958400 00000001:00000004:0.0:1788572482.161635:0:22257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902005 00000100:00080000:3.0:1788572482.393351:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572482.393362:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901897 gen 4 00000004:00080000:3.0:1788572482.393379:0:22257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572482.393382:0:22257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788572482.394651:0:18922:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788572482.394657:0:18922:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 3 count 1 00000040:00080000:0.0:1788572482.394668:0:18922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 3 count 2 00000100:00080000:3.0:1788572482.395788:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572482.395795:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901908 gen 4 00000004:00080000:3.0:1788572482.395818:0:22257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572482.395821:0:22257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788572482.396360:0:18924:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788572482.396364:0:18924:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 4 count 1 00000040:00080000:0.0:1788572482.396373:0:18924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 3 count 2 00000020:00000080:3.0:1788572482.572547:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d62 00000020:00000080:3.0:1788572482.572560:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c07b5eb000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572482.573783:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b5eb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788572482.574647:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d77 00000020:00000080:3.0:1788572482.574656:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf4531a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788572482.574719:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788572482.574727:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.574736:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572482.574741:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff88bf46073380) has no exports 00000004:01000000:3.0:1788572482.574916:0:22257:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788572482.574926:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00dc4 00000020:00000080:3.0:1788572482.574931:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c074cbe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572482.575542:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788572482.575608:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788572482.575613:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.575618:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788572482.575621:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff88c0485499c0) has no exports 00000020:00000080:3.0:1788572482.575627:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00dbd 00000020:00000080:3.0:1788572482.575632:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c074cb9800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788572482.576184:0:22257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788572482.576189:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572482.576202:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901908 gen 5 00000004:00080000:3.0:1788572482.576209:0:22257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572482.576212:0:22257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572482.576243:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.576382:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572482.576392:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00daf 00000020:00000080:3.0:1788572482.576399:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c074cb9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788572482.576403:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788572482.576407:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.576410:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788572482.576413:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff88c049bab380) has no exports 00000020:00000080:3.0:1788572482.576417:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00da8 00000020:00000080:3.0:1788572482.576420:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf4531d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572482.576786:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cbe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788572482.576794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cb9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572482.576800:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c074cb8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788572482.576814:0:37:0:(genops.c:885:class_export_put()) final put ffff88c074cbb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572482.576817:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cbb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788572482.576821:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572482.576953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cb9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788572482.576958:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788572482.577128:0:22257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788572482.577131:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572482.577134:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901897 gen 5 00000004:00080000:3.0:1788572482.577139:0:22257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572482.577141:0:22257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572482.577214:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.577219:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572482.577244:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.577281:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572482.577285:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c07b5ee000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572482.577288:0:22257:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b5ee000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788572482.577292:0:22257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572482.577402:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d7e 00000020:00000080:3.0:1788572482.577408:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf4531c000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788572482.577798:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf4531f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788572482.577805:0:37:0:(genops.c:885:class_export_put()) final put ffff88c07b5e8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572482.577807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b5e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788572482.577812:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788572482.577947:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788572482.577953:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.577959:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572482.577963:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff88c049bacd40) has no exports 00000020:00000080:3.0:1788572482.577983:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.578003:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788572482.578008:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d85 00000020:00000080:3.0:1788572482.578012:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf4531b000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788572482.578021:0:22257:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bf463fa000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788572482.578024:0:22257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf463fa000 3 00000020:01000004:3.0:1788572482.578027:0:22257:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88bf463fa000 from lustre-MDT0000 00000020:00000080:3.0:1788572482.578045:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.578048:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788572482.578050:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c07b5ec000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788572482.578052:0:22257:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b5ec000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788572482.578059:0:22257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788572482.578092:0:22257:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788572482.578096:0:22257:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788572482.578098:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788572482.578101:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.578104:0:22257:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788572482.578110:0:22257:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff88bf46435000 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572482.578116:0:22257:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff88c0760a19c0) has exports, disconnecting them 00000020:00080000:3.0:1788572482.578120:0:22257:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88bf46435000), last request at 1788572377 00000020:00000080:3.0:1788572482.578135:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d23 00000020:00010000:3.0:1788572482.578139:0:22257:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88bf46435000: total 2 00000100:00080000:3.0:1788572482.578144:0:22257:0:(import.c:65:import_set_state_nolock()) ffff88bf46436800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572482.578154:0:22257:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bf46435000): rc 0 00000020:00080000:3.0:1788572482.578158:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff88c0760a19c0) has no exports 00000020:00010000:0.0:1788572482.578231:0:19971:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88bf46435000: total 2 00010000:00010000:0.0:1788572482.578290:0:19971:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88bf46435000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788572482.578323:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0d800/0x977d9e7969c00d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00d31 expref: 9 pid: 18894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578341:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4d400/0x977d9e7969c00fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00fae expref: 8 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578351:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076994800/0x977d9e7969c00e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00e81 expref: 7 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578362:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076994000/0x977d9e7969c00e50 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00e49 expref: 6 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578376:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4c800/0x977d9e7969c0117c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c01175 expref: 5 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578386:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024ac00/0x977d9e7969c00fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00fd8 expref: 4 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578395:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0da00/0x977d9e7969c00e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c00e57 expref: 3 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578406:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4c600/0x977d9e7969c0118a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969c01183 expref: 2 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572482.578424:0:19971:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88bf46435000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788572482.578436:0:19971:0:(genops.c:885:class_export_put()) final put ffff88bf46435000/9d30dbdd-f5a4-422c-b74e-bd4abc20af0e 00010000:00010000:0.0:1788572482.578446:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572482.578448:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572482.578450:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572482.578658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788572482.578663:0:37:0:(genops.c:885:class_export_put()) final put ffff88c07b5ee800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788572482.578665:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b5ee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788572482.578669:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:3.0:1788572482.578789:0:18894:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff88c0502f5000:18894] 1 exiting: rc = 0 00000100:00100000:0.0:1788572482.581235:0:18892:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff88c05032d200:18892] 0 exiting: rc = 1 00000100:00100000:0.0:1788572482.581367:0:18895:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff88bf450e5600:18895] 2 exiting: rc = 0 00000100:00100000:3.0:1788572482.581542:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581550:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581556:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581561:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581566:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581576:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581581:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581603:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581608:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581614:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581619:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581627:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581633:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581639:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581644:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581650:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581655:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581660:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581666:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581671:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581676:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581681:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581698:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581703:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581708:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581714:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581719:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581724:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581729:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581734:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581740:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581745:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581750:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581756:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581761:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581767:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581773:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581779:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581785:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581791:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581797:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581802:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581814:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581819:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581824:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581831:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581836:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581841:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581847:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581862:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581868:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581873:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581879:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581884:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581889:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581894:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581900:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581905:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581911:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581917:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581922:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581928:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581933:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.581939:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788572482.582654:0:22257:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788572482.582658:0:22257:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1788572482.583433:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572482.583441:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf46435000/9d30dbdd-f5a4-422c-b74e-bd4abc20af0e for MGS 00000020:00000080:1.0:1788572482.583486:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf46436800 for MGS 00000020:01000000:3.0:1788572482.590678:0:22257:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c065abcea0 - data ffff88c079a7dbd0/ffff88bf46803400 00000020:01000000:3.0:1788572482.590872:0:22257:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0512035a0 - data ffff88c066320e58/ffff88bf463eb800 00000020:00000080:3.0:1788572482.591375:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d0e 00000020:00000080:3.0:1788572482.591383:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf46436000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788572482.591406:0:22257:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bf463fa000 from MGS, refs=2 00000020:01000004:3.0:1788572482.591410:0:22257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf463fa000 2 00000020:01000004:3.0:1788572482.591413:0:22257:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88bf463fa000 from MGS 00000020:00000080:3.0:1788572482.591433:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.591440:0:22257:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788572482.591442:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf46431000/MGS 00000020:00000080:3.0:1788572482.591445:0:22257:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf46431000/MGS for MGS 00000020:01000000:3.0:1788572482.591471:0:22257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788572482.591519:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788572482.591522:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.591527:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788572482.591534:0:22257:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88bf4531f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572482.591540:0:22257:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff88c049ba8000) has exports, disconnecting them 00000020:00080000:3.0:1788572482.591545:0:22257:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88bf4531f000), last request at 1788572377 00000020:00000080:3.0:1788572482.591549:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00dfc 00000020:00080000:3.0:1788572482.591557:0:22257:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bf4531f000): rc 0 00000020:00000080:3.0:1788572482.591561:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf4531f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788572482.592176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf46436000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572482.592185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788572482.614090:0:22257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788572482.614102:0:22257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572482.614108:0:22257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788572482.614117:0:22257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572482.614635:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572482.614645:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788572482.614651:0:22257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf463fa000 1 00000020:00000080:3.0:1788572482.614658:0:22257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d00 00000020:00000080:3.0:1788572482.614667:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf46430800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572482.615231:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0556c1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788572482.615241:0:36:0:(genops.c:885:class_export_put()) final put ffff88c074cbc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788572482.615244:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cbc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788572482.615284:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788572482.615504:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788572482.615510:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572482.615518:0:22257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572482.615523:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff88c058ee99c0) has no exports 00000020:00000080:1.0:1788572482.616951:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf46430800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572482.642731:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572482.642748:0:22257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788572482.642754:0:22257:0:(genops.c:885:class_export_put()) final put ffff88bf463fc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572482.642759:0:22257:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf463fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788572482.642782:0:22257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788572482.642930:0:22257:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88bf463fe800 00000020:01000000:1.0:1788572482.642958:0:22257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788572482.642963:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572482.642968:0:22257:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788572482.642972:0:22257:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff88bf46074d40) has no exports 00000100:00100000:3.0:1788572482.647723:0:18902:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff88bf45317400:18902] 2 exiting: rc = 0 00000100:00100000:3.0:1788572482.647847:0:18900:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff88c07c409a00:18900] 0 exiting: rc = 1 00000100:00100000:1.0:1788572482.648077:0:18901:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff88c047573c00:18901] 1 exiting: rc = 0 00000100:00100000:1.0:1788572482.648151:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648158:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648164:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648169:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648175:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648181:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648188:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648194:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648200:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648205:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648210:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648214:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648220:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648225:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648230:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648235:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648240:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648270:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648282:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648287:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648292:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648297:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648304:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648309:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648315:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648320:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648326:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648349:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648366:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648377:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648384:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648391:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648397:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648402:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648408:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648417:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648422:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648426:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648432:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648436:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648441:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648446:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648451:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648467:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648474:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648479:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648485:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648491:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648496:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648501:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648507:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648512:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648517:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648523:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648529:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648545:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648553:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648561:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648566:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648573:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648578:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648586:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648599:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.648604:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.654303:0:18904:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88bf45113200:18904] 1 exiting: rc = 0 00000100:00100000:0.0:1788572482.654534:0:18903:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88bf45113800:18903] 0 exiting: rc = 1 00000100:00100000:1.0:1788572482.654640:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654652:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654658:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654664:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654671:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654677:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654747:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654755:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654761:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654765:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654770:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654775:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654780:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654785:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654790:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654794:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654798:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654803:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654808:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654813:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654818:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654823:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654828:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654832:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654838:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654842:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654848:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654853:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654857:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654863:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654868:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654874:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654881:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654903:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654909:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654916:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654922:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654928:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654933:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654939:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654945:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654950:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654956:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654961:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654967:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654973:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654979:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.654985:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655057:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655065:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655070:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655075:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655081:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655086:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655091:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655096:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655101:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655107:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655112:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655117:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655122:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655128:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655134:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.655139:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572482.659657:0:18906:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff88bf45113600:18906] 1 exiting: rc = 0 00000100:00100000:3.0:1788572482.660296:0:18905:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff88bf45113a00:18905] 0 exiting: rc = 1 00000100:00100000:1.0:1788572482.660469:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660481:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660488:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660494:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660517:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660524:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660530:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660537:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660543:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660549:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660555:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660562:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660584:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660592:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660598:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660604:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660610:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660615:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660621:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660633:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660639:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660645:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660650:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660656:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660677:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660684:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660690:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660697:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660703:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660709:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660716:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660722:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660727:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660733:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660740:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660745:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660769:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660778:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660784:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660798:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660804:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660809:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660815:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660821:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660828:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660835:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660841:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660848:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660870:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660877:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660882:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660888:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660894:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660900:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660905:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660912:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660917:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660924:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660930:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660936:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660960:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660969:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660975:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.660981:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572482.669221:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3297:1875453518440960:0@lo:400:kworker.0 00000400:00000100:0.0:1788572482.669302:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875453518440960 offset 0 length 224: 4 00000100:00100000:0.0:1788572482.669357:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572482.669364:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518441088:0@lo:400:kworker.0 00000400:00000100:0.0:1788572482.669383:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518441088 offset 0 length 224: 4 00000100:00100000:0.0:1788572482.669410:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518441216:0@lo:400:kworker.0 00000400:00000100:0.0:1788572482.669427:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518441216 offset 0 length 224: 4 00000100:00100000:3.0:1788572482.670720:0:18907:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88bf45113400:18907] 0 exiting: rc = 1 00000100:00100000:0.0:1788572482.671444:0:18908:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88bf45112800:18908] 1 exiting: rc = 0 00000100:00100000:1.0:1788572482.671595:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671602:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671607:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671612:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671617:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671622:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671626:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671632:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671638:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671643:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671660:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671666:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671670:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671675:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671679:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671684:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671689:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671695:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671700:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671705:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671709:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671715:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671719:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671725:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671731:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671736:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671741:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671746:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671750:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671755:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671759:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671765:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671770:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671776:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671781:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671787:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671793:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671799:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671804:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671809:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671813:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671817:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671822:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671827:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671831:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671845:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671850:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671854:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671858:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671862:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671867:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671872:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671876:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671880:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671885:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671889:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671893:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671897:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671901:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671906:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671910:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671914:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671919:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.671923:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672293:0:18909:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88bf45113000:18909] 0 exiting: rc = 1 00000100:00100000:3.0:1788572482.672409:0:18910:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88bf45112600:18910] 1 exiting: rc = 0 00000100:00100000:1.0:1788572482.672557:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672563:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672568:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672574:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672579:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672584:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672589:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672594:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672599:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672604:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672609:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672614:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672619:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672624:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672629:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672642:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672646:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672651:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672656:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672661:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672666:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672671:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672675:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672680:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672684:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672689:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672694:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672699:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672704:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672709:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672713:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672718:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672723:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672728:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672732:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672737:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672742:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672746:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672751:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672756:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672760:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672765:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672769:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672775:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672780:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672785:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672790:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672796:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672801:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672806:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672817:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672822:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672827:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672833:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672838:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672843:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672847:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672852:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672856:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672861:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672866:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672870:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672875:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.672880:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673195:0:18911:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff88c058f54c00:18911] 0 exiting: rc = 1 00000100:00100000:3.0:1788572482.673330:0:18912:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff88bf450e4800:18912] 1 exiting: rc = 0 00000100:00100000:1.0:1788572482.673472:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673479:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673484:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673490:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673495:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673500:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673505:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673510:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673515:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673519:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673524:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673529:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673534:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673539:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673543:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673548:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673553:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673557:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673562:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673567:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673577:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673582:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673587:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673592:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673597:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673602:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673607:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673612:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673617:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673621:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673626:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673631:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673636:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673641:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673645:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673650:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673655:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673660:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673664:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673669:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673673:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673677:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673682:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673687:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673691:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673696:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673701:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673705:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673710:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673715:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673719:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673724:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673728:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673733:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673738:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673750:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673754:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673759:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673764:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673768:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673773:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673778:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673783:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.673788:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572482.674698:0:18913:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff88c051495a00:18913] 0 exiting: rc = 1 00000100:00100000:0.0:1788572482.674948:0:18914:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff88c051495e00:18914] 1 exiting: rc = 0 00000100:00100000:0.0:1788572482.675199:0:18915:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff88c051494200:18915] 2 exiting: rc = 0 00000100:00100000:1.0:1788572482.675371:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675379:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675384:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675391:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675397:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675403:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675409:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675416:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675421:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675427:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675433:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675439:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675445:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675450:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675465:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675474:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675481:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675486:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675491:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675509:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675516:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675521:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675526:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675532:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675537:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675542:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675560:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675566:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675573:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675579:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675586:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675594:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675600:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675605:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675611:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675616:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675622:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675626:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675630:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675636:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675641:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675646:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675651:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675671:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675678:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675684:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675689:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675693:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675698:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675704:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675709:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675715:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675721:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675727:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675732:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675738:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675743:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675748:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675754:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675760:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675766:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675778:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675784:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572482.675789:0:22257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788572482.679900:0:22257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572482.679913:0:22257:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788572482.679919:0:22257:0:(genops.c:885:class_export_put()) final put ffff88c05189b000/MDS_uuid 00000020:00000080:1.0:1788572482.679924:0:22257:0:(genops.c:844:class_export_destroy()) destroying export ffff88c05189b000/MDS_uuid for MDS 00000020:01000000:1.0:1788572482.679929:0:22257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788572482.680063:0:22257:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788572482.860639:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572483.764525:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572483.764534:0:7635:0:(genops.c:885:class_export_put()) final put ffff88c050279000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572483.764560:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c050279000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788572483.764601:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c05027d800 for lustre-OST0001 00010000:00010000:1.0:1788572483.888885:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572484.911422:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572485.929391:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572486.091008:0:22409:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788572486.108631:0:22409:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788572486.108678:0:22409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572486.108695:0:22409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572486.108703:0:22409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572486.108710:0:22409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572486.108731:0:22409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572486.108735:0:22409:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788572486.108756:0:22409:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572486.108767:0:22409:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07f7f6300 x1875453518441088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572498 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572486.108784:0:22409:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788572486.108789:0:22409:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788572486.108811:0:22409:0:(import.c:65:import_set_state_nolock()) ffff88c07bb13800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788572486.109041:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518441088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572486.109655:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518441344:0@lo:39:umount.0 00000400:00000100:0.0:1788572486.109701:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518441344 offset 0 length 224: 4 00010000:00010000:2.0:1788572486.115136:0:18888:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572486.115150:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572486.115162:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995c00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572486.115167:0:18888:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572486.115177:0:18888:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572486.115184:0:18888:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572486.115190:0:18888:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572486.115193:0:18888:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572486.115196:0:18888:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572486.115306:0:18888:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572486.115333:0:18888:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572486.115370:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572486.115378:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c00e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969c00e88 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572486.115391:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572486.115393:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572486.115395:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572486.115715:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518441472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572486.115798:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572486.116036:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518441472 00000100:00100000:0.0:1788572486.116053:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518441472 00000100:00100000:0.0:1788572486.116116:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572486.116125:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1875453518441472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788572486.116133:0:18887:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788572486 with bad export cookie 10916055316118375715 00000100:00100000:3.0:1788572486.129434:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1875453518441472:12345-0@lo:103:ldlm_bl.0 Request processed in 13298us (13625us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788572486.129449:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788572486.129536:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572486.129541:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88c06bfd8000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788572486.129545:0:3300:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788572486.137112:0:3300:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.102@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788572486.137118:0:3300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788572486.137129:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07f7f7800 x1875453518440960/t0(0) o400->MGC192.168.202.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572498 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572486.137159:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c04a555500 x1875453518441472/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788572502 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788572486.137168:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788572486.137171:0:3300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788572486.137172:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788572486.137176:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88c06bfd8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572486.137181:0:3300:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 598 00000100:00080000:1.0:1788572486.137189:0:3300:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import ffff88c06bfd8000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788572486.137227:0:3300:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf47694e00 x1875453518441600/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572486.137317:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3297:1875453518440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788572486.137673:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3296:1875453518441600:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:1.0:1788572486.137807:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3300:1875453518441472:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788572486.137853:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875453518441600 offset 0 length 520: 4 00010000:00010000:0.0:1788572486.953834:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572487.784471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572487.784481:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788572487.784682:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518441728:0@lo:400:kworker.0 00000400:00000100:0.0:1788572487.784739:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518441728 offset 0 length 224: 4 00010000:00010000:0.0:1788572487.977225:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572489.000421:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572490.024551:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572490.798098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572490.798109:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788572490.798236:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572490.805741:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518441856:0@lo:400:kworker.0 00000400:00000100:0.0:1788572490.805809:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518441856 offset 0 length 224: 4 00010000:00010000:0.0:1788572491.056887:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572492.072446:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572493.104616:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572494.121121:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572495.145048:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572495.976614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572495.976624:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788572495.976753:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518441984:0@lo:400:kworker.0 00000400:00000100:3.0:1788572495.976807:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518441984 offset 0 length 224: 4 00010000:00010000:0.0:1788572496.168512:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572496.491984:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572486/real 1788572486] req@ffff88bf47694e00 x1875453518441600/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572496 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572496.492017:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bf47694e00 x1875453518441600/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572496 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572496.492029:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572486/real 1788572486] req@ffff88bf47697b80 x1875453518441344/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572496 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572496.492059:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bf47697b80 x1875453518441344/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572496 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572496.492079:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c06bfd8000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572496.492110:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788572496.492114:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3296:1875453518441600:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788572496.492122:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c07bb13800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572496.492138:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518441344:0@lo:39:umount.0 00000100:00080000:3.0:1788572496.492236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572496.492241:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788572496.492244:0:36:0:(import.c:65:import_set_state_nolock()) ffff88c06bfd8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572496.492270:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 706 00000100:00080000:3.0:1788572496.492276:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572496.492283:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import ffff88c06bfd8000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572496.492315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c049acb800 x1875453518442112/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572496.492388:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572496.492402:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518442240:0@lo:400:kworker.0 00000400:00000100:3.0:1788572496.492492:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518442240 offset 0 length 224: 4 00000100:00100000:0.0:1788572496.492719:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3296:1875453518442112:0@lo:250:kworker.0 00000400:00000100:0.0:1788572496.492741:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875453518442112 offset 0 length 520: 4 00000100:00080000:1.0:1788572496.493426:0:22409:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572496.493432:0:22409:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572496.493438:0:22409:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788572496.494958:0:22409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.494991:0:22409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.494999:0:22409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.495005:0:22409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.495096:0:22409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572496.495105:0:22409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.495112:0:22409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.495119:0:22409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.495125:0:22409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502425:0:18889:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572496.502442:0:18889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502453:0:18889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572496.502467:0:18889:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502479:0:18889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572496.502486:0:18889:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572496.502491:0:18889:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572496.502494:0:18889:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788572496.502545:0:18889:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:0.0:1788572496.502549:0:18889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502557:0:18889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040030200/0x977d9e7969c00e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00e5e expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502575:0:18889:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572496.502578:0:18889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502583:0:18889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994e00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572496.502586:0:18889:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502592:0:18889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572496.502598:0:18889:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572496.502603:0:18889:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788572496.502605:0:18889:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788572496.502609:0:18889:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:0.0:1788572496.502611:0:18889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.502618:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.502620:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.502622:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.503865:0:22409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572496.503880:0:22409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076994e00/0x977d9e7969c01183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c0118a expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572496.503901:0:22409:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788572496.503911:0:22409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788572496.503915:0:22409:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1788572496.503929:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572496.503974:0:22409:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788572496.503978:0:22409:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788572496.503986:0:22409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572496.503992:0:22409:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788572496.503998:0:22409:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff88c058eeb380) has no exports 00000020:00080000:1.0:1788572496.504029:0:22409:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff88c058eeb380) has no exports 00000020:01000000:1.0:1788572496.506716:0:22409:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0518de660 - data ffff88c07042d000/ffff88bf46806800 00000020:01000000:1.0:1788572496.506895:0:22409:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0485a8d80 - data ffff88c0663f6948/ffff88bf4108c000 00100000:10000000:1.0:1788572496.526428:0:22409:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788572496.577344:0:22409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00e6c 00000020:00000080:2.0:1788572496.577354:0:22409:0:(genops.c:885:class_export_put()) final put ffff88c07b809000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788572496.577369:0:22409:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c074cba800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788572496.577373:0:22409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c074cba800 2 00000020:01000004:2.0:1788572496.577376:0:22409:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88c074cba800 from lustre-OST0000 00000020:00000080:2.0:1788572496.577399:0:22409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572496.577408:0:22409:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788572496.577411:0:22409:0:(genops.c:885:class_export_put()) final put ffff88c07b80a000/lustre-OST0000_UUID 00000020:00000080:2.0:1788572496.577414:0:22409:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b80a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788572496.577420:0:22409:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788572496.577466:0:22409:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788572496.577471:0:22409:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788572496.577474:0:22409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572496.577479:0:22409:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788572496.577485:0:22409:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88c050279800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572496.577492:0:22409:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff88bf475e4d40) has exports, disconnecting them 00000020:00080000:2.0:1788572496.577509:0:22409:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88c050279800), last request at 1788572394 00000020:00000080:2.0:1788572496.577514:0:22409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00e96 00000020:00080000:2.0:1788572496.577523:0:22409:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c050279800): rc 0 00000020:00000080:2.0:1788572496.577528:0:22409:0:(genops.c:885:class_export_put()) final put ffff88c050279800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788572496.577930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b809000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788572496.577942:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c050279800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788572496.580329:0:22409:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788572496.580339:0:22409:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572496.580345:0:22409:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788572496.580353:0:22409:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572496.580570:0:22409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572496.580580:0:22409:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788572496.580588:0:22409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c074cba800 1 00000020:00000080:3.0:1788572496.580596:0:22409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00e3b 00000020:00000080:3.0:1788572496.580605:0:22409:0:(genops.c:885:class_export_put()) final put ffff88c07bb16000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788572496.580610:0:22409:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788572496.580617:0:22409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572496.580620:0:22409:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572496.580624:0:22409:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff88c049ba99c0) has no exports 00000020:00000080:1.0:1788572496.581417:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c07bb13800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788572496.581428:0:36:0:(genops.c:885:class_export_put()) final put ffff88bf4746e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788572496.581431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4746e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788572496.581441:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788572496.581510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07bb16000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788572496.633301:0:22409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572496.633318:0:22409:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788572496.633325:0:22409:0:(genops.c:885:class_export_put()) final put ffff88bf4530e000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788572496.633329:0:22409:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4530e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788572496.633337:0:22409:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788572496.633519:0:22409:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88c074cbc800 00000020:02000400:1.0:1788572496.634000:0:22409:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788572497.194883:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572498.217479:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788572498.537639:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572482/real 1788572482] req@ffff88c07f7f6680 x1875453518441216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572498.576368:0:3299:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff88c07f7f6680 x1875453518441216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572498.576383:0:3299:0:(import.c:65:import_set_state_nolock()) ffff88c0508a8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572498.576386:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788572498.588402:0:3299:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1788572498.589218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572498.589224:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572498.589226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572498.589230:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572498.589233:0:37:0:(import.c:65:import_set_state_nolock()) ffff88c0508a8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572498.589242:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 631 00000100:00080000:3.0:1788572498.589274:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88c0508a8800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572498.589323:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c049ac8700 x1875453518442368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572498.589527:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518442368:0@lo:38:kworker.0 00000400:00000100:1.0:1788572498.589637:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518442368 offset 0 length 520: 4 00000100:00100000:0.0:1788572498.589822:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518441216:0@lo:400:kworker.0 00010000:00010000:2.0:1788572499.240341:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788572499.617240:0:22561:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788572499.640879:0:22561:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788572499.640980:0:22561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.640996:0:22561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.641003:0:22561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.641010:0:22561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.641037:0:22561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788572499.641043:0:22561:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788572499.641069:0:22561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572499.641082:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c049acad80 x1875453518441728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572503 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641117:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bf47695f80 x1875453518441856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641126:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07f7f6d80 x1875453518441984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641140:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c049acbb80 x1875453518442240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641147:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c049ac8700 x1875453518442368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788572508 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641164:0:22561:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788572499.641197:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518442240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572499.641205:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518441984:0@lo:400:kworker.0 00000100:00080000:0.0:1788572499.641237:0:22561:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788572499.641243:0:22561:0:(import.c:65:import_set_state_nolock()) ffff88c0508a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788572499.641275:0:22561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572499.641280:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c049acad80 x1875453518441728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572503 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641289:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bf47695f80 x1875453518441856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641297:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c049ac8700 x1875453518442368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788572508 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572499.641303:0:22561:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788572499.641306:0:22561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:2.0:1788572499.641488:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572499.641496:0:19971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572499.641504:0:19971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995e00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572499.641508:0:19971:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572499.641517:0:19971:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572499.641523:0:19971:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572499.641529:0:19971:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572499.641531:0:19971:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572499.641534:0:19971:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572499.641546:0:19971:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:2.0:1788572499.641550:0:19971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572499.641558:0:19971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00fd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00fdf expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572499.641568:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572499.641578:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572499.641580:0:19971:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572499.641693:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518441856:0@lo:400:kworker.0 00000100:00100000:3.0:1788572499.641726:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518441728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572499.642043:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518442368:0@lo:38:kworker.0 00010000:00010000:0.0:1788572499.647292:0:22561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647327:0:22561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647334:0:22561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647341:0:22561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647364:0:22561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572499.647371:0:22561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647378:0:22561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647384:0:22561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647390:0:22561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572499.647407:0:22561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788572499.647413:0:22561:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788572499.647440:0:22561:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788572499.647454:0:22561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788572499.647459:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572499.647465:0:22561:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788572499.647470:0:22561:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff88bf47594d40) has no exports 00000020:00080000:0.0:1788572499.647503:0:22561:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff88bf47594d40) has no exports 00010000:00010000:1.0:1788572499.647841:0:18888:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572499.647850:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.647871:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c400 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788572499.647875:0:18888:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.647884:0:18888:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572499.647891:0:18888:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572499.647897:0:18888:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572499.647900:0:18888:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788572499.647902:0:18888:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788572499.647915:0:18888:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:1.0:1788572499.647919:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.647926:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c052e4c400/0x977d9e7969c00fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00fb5 expref: -99 pid: 20306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.647952:0:18888:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572499.647956:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.647962:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994400 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788572499.647965:0:18888:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.647972:0:18888:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572499.647984:0:18888:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572499.647989:0:18888:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788572499.647991:0:18888:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788572499.647993:0:18888:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788572499.647998:0:18888:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:1.0:1788572499.648001:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.648007:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076994400/0x977d9e7969c01175 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c0117c expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572499.648019:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572499.648021:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572499.648023:0:18888:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572499.648876:0:18889:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788572499.651308:0:22561:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0518de120 - data ffff88c066108ca8/ffff88c06c90bc00 00000020:01000000:0.0:1788572499.651509:0:22561:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88bf4554aba0 - data ffff88c07fed35e8/ffff88bf46801c00 00100000:10000000:0.0:1788572499.659794:0:22561:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788572499.683311:0:22561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00fc3 00000020:00000080:3.0:1788572499.683322:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c0513c2000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788572499.683337:0:22561:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c07b80c000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788572499.683341:0:22561:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c07b80c000 2 00000020:01000004:3.0:1788572499.683344:0:22561:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88c07b80c000 from lustre-OST0001 00000020:00000080:3.0:1788572499.683366:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572499.683375:0:22561:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788572499.683378:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c0513c3000/lustre-OST0001_UUID 00000020:00000080:3.0:1788572499.683381:0:22561:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0513c3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788572499.683388:0:22561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788572499.683477:0:22561:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e->MGS 00010000:00010000:3.0:1788572499.683502:0:22561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969c00e49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00e50 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572499.683514:0:22561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969c00e49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00e50 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572499.683520:0:22561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788572499.683522:0:22561:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788572499.683525:0:22561:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788572499.683539:0:22561:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:3.0:1788572499.683543:0:22561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969c00e49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00e50 expref: -99 pid: 19587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572499.683559:0:22561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c052e4d800/0x977d9e7969c00d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969c00d38 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572499.683565:0:22561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c052e4d800/0x977d9e7969c00d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969c00d38 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572499.683586:0:22561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572499.683589:0:22561:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788572499.683590:0:22561:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788572499.683601:0:22561:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c06bfd8000 00010000:00010000:3.0:1788572499.683604:0:22561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c052e4d800/0x977d9e7969c00d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969c00d38 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788572499.683623:0:22561:0:(import.c:65:import_set_state_nolock()) ffff88c06bfd8000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788572499.683627:0:22561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788572499.683629:0:22561:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788572499.683630:0:22561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788572499.683634:0:22561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788572499.683645:0:22561:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c049acb800 x1875453518442112/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788572511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788572499.683657:0:22561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788572499.683659:0:22561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788572499.683857:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30dbdd-f5a4-422c-b74e-bd4abc20af0e:3296:1875453518442112:0@lo:250:kworker.0 10000000:01000000:3.0:1788572499.684017:0:22561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788572499.684025:0:22561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00d1c 00000020:00000080:3.0:1788572499.684030:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c06bfda800/9d30dbdd-f5a4-422c-b74e-bd4abc20af0e 00000020:01000000:3.0:1788572499.684036:0:22561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.102@tcp (flags='') 00000020:00000080:3.0:1788572499.684041:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572499.684045:0:22561:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788572499.684049:0:22561:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff88bf460719c0) has no exports 10000000:01000000:1.0:1788572499.684106:0:18897:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788572499.684169:0:22561:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.102@tcp: client import never connected 00000100:00080000:3.0:1788572499.684172:0:22561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788572499.684174:0:22561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788572499.684176:0:22561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788572499.684177:0:22561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788572499.684210:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572499.684214:0:22561:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.102@tcp (uuid 9d30dbdd-f5a4-422c-b74e-bd4abc20af0e) 00000020:01000000:3.0:1788572499.684219:0:22561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788572499.684226:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572499.684230:0:22561:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788572499.684234:0:22561:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88c07633b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572499.684239:0:22561:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff88c04854cd40) has exports, disconnecting them 00000020:00080000:3.0:1788572499.684243:0:22561:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88c07633b000), last request at 1788572410 00000020:00000080:3.0:1788572499.684269:0:22561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00fed 00000020:00080000:3.0:1788572499.684279:0:22561:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c07633b000): rc 0 00000020:00000080:3.0:1788572499.684283:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c07633b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788572499.685267:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0513c2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788572499.685285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c06bfda800/9d30dbdd-f5a4-422c-b74e-bd4abc20af0e for MGC192.168.202.102@tcp 00000020:00000080:2.0:1788572499.685291:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c06bfd8000 for MGC192.168.202.102@tcp 00000020:00000080:2.0:1788572499.685297:0:37:0:(genops.c:885:class_export_put()) final put ffff88c06bfde000/9d30dbdd-f5a4-422c-b74e-bd4abc20af0e 00000020:00000080:2.0:1788572499.685299:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c06bfde000/9d30dbdd-f5a4-422c-b74e-bd4abc20af0e for MGC192.168.202.102@tcp 00000020:01000000:2.0:1788572499.685304:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.102@tcp (9d30dbdd-f5a4-422c-b74e-bd4abc20af0e) 00000020:00000080:2.0:1788572499.685564:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07633b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788572499.686315:0:22561:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788572499.686320:0:22561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572499.686325:0:22561:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572499.686332:0:22561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788572499.686393:0:19971:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788572499.686621:0:18888:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1788572499.686700:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0508a8800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788572499.686907:0:18889:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788572499.687122:0:18883:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88c059239800:18883] 0 exiting: rc = 1 00000100:00100000:1.0:1788572499.687175:0:18884:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88c059239e00:18884] 1 exiting: rc = 0 00000100:00100000:2.0:1788572499.687291:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.688381:0:18886:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88c0677aac00:18886] 1 exiting: rc = 0 00000100:00100000:2.0:1788572499.691234:0:18885:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88bf45099a00:18885] 0 exiting: rc = 1 00000100:00100000:2.0:1788572499.692342:0:18887:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88c0677ab000:18887] 2 exiting: rc = 0 00000100:00100000:1.0:1788572499.692614:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692623:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692629:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692636:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692641:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692663:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692669:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692687:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692692:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692697:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692703:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692709:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692715:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692721:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692727:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692733:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692740:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692745:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692751:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692757:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692763:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692769:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692775:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692780:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692786:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.692999:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693010:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693016:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693021:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693026:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693032:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693038:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693044:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693051:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693056:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693062:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693066:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693071:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693076:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693082:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693097:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693103:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693109:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693113:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693119:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693124:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693129:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693134:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693139:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693144:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693149:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693155:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693160:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693166:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693171:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693176:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693182:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693188:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693193:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693198:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693204:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693209:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693216:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.693221:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788572499.695432:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572499.695458:0:22561:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788572499.695464:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c07c55e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788572499.695468:0:22561:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788572499.695478:0:22561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788572499.695537:0:22561:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c07b80c000 1 00000020:00000080:1.0:1788572499.695544:0:22561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969c00fa7 00000020:00000080:1.0:1788572499.695555:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c07b80e800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788572499.695565:0:22561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788572499.695569:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572499.695584:0:22561:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572499.695588:0:22561:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff88c058eecd40) has no exports 00000020:00000080:2.0:1788572499.695966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b80e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788572499.710652:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572499.710670:0:22561:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788572499.712826:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c07b80f800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788572499.712831:0:22561:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b80f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788572499.712838:0:22561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788572499.713111:0:22561:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88c07b80e000 00000020:01000000:1.0:1788572499.713147:0:22561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788572499.713153:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572499.713158:0:22561:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788572499.713163:0:22561:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff88c0760a4d40) has no exports 00000020:00000080:1.0:1788572499.713191:0:22561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572499.713199:0:22561:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788572499.713201:0:22561:0:(genops.c:885:class_export_put()) final put ffff88c07bb11800/OSS_uuid 00000020:00000080:1.0:1788572499.713204:0:22561:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07bb11800/OSS_uuid for OSS 00000020:01000000:1.0:1788572499.713209:0:22561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788572499.713687:0:19591:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff88c0474e4200:19591] 2 exiting: rc = 0 00000100:00100000:0.0:1788572499.713783:0:19590:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff88c0474e5400:19590] 1 exiting: rc = 0 00000100:00100000:0.0:1788572499.713828:0:19969:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff88c076330c00:19969] 3 exiting: rc = 0 00000100:00080000:2.0:1788572499.714108:0:18896:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788572499.714191:0:19589:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff88c07640f800:19589] 0 exiting: rc = 1 00000100:00100000:1.0:1788572499.715899:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.715911:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.715917:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.715922:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.715927:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.715932:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716116:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716126:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716131:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716135:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716140:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716145:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716151:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716156:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716161:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716166:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716171:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716198:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716204:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716208:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716215:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716220:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716224:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716229:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716234:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716238:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716242:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716274:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716282:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716288:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716293:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716299:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716306:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716311:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716316:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716322:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716330:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716335:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716340:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716344:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716350:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716358:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716363:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716372:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716377:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716384:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716390:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716395:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716400:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716405:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716410:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716415:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716430:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716437:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716443:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716460:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716465:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716470:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716475:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716480:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716485:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716602:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716608:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.716613:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.719934:0:19593:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88c04849d400:19593] 1 exiting: rc = 0 00000100:00100000:2.0:1788572499.720051:0:21886:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff88c05024c200:21886] 2 exiting: rc = 0 00000100:00100000:2.0:1788572499.723456:0:19592:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88c050329200:19592] 0 exiting: rc = 1 00000100:00100000:1.0:1788572499.723718:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723727:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723732:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723737:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723742:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723747:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723752:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723756:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723761:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723767:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723772:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723777:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723782:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723786:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723791:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723810:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723816:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723821:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723826:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723830:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723834:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723839:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723843:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723866:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723871:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723876:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723881:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723887:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723892:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723897:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723902:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723909:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723914:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723919:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723925:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723931:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.723936:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724122:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724130:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724135:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724141:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724146:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724152:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724157:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724162:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724168:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724173:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724179:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724184:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724190:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724195:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724200:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724204:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724209:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724214:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724220:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724224:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724232:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724282:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724290:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724296:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724301:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724305:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.724311:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.725851:0:19595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88c058f11c00:19595] 1 exiting: rc = 0 00000100:00100000:1.0:1788572499.726235:0:19596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88c0764d3a00:19596] 2 exiting: rc = 0 00000100:00100000:2.0:1788572499.726443:0:21035:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff88c076475800:21035] 3 exiting: rc = 0 00000100:00100000:3.0:1788572499.727093:0:19594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88c058f10600:19594] 0 exiting: rc = 1 00000100:00100000:1.0:1788572499.727310:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727318:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727323:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727328:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727334:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727340:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727346:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727351:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727375:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727382:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727388:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727395:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727400:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727406:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727412:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727418:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727424:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727430:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727436:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727442:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727457:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727463:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727468:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727474:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727480:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.727485:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728060:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728068:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728084:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728090:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728096:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728102:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728125:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728132:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728138:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728144:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728149:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728155:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728160:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728166:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728172:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728178:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728184:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728190:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728196:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728202:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728207:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728212:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728218:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728223:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728229:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728235:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728240:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728245:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728274:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728280:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728301:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728307:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728313:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728319:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728325:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728333:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728339:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.728353:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.753736:0:19598:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88c052feee00:19598] 1 exiting: rc = 0 00000100:00100000:2.0:1788572499.757375:0:19597:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88c052fee400:19597] 0 exiting: rc = 1 00000100:00100000:1.0:1788572499.757640:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757649:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757656:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757662:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757666:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757683:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757690:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757695:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757699:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757707:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757712:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757717:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757723:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757728:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757733:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757739:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757745:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757750:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757755:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757760:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757766:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757775:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757780:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757788:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757793:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757798:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757803:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757809:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757818:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757824:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757829:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757834:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757878:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757903:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757908:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757913:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757918:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757924:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757929:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757934:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757950:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757956:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757962:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757969:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757978:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757984:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757989:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757994:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.757999:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758004:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758009:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758016:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758023:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758031:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758039:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758043:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758049:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758054:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758059:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758065:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758070:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758077:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758083:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.758089:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572499.761102:0:19599:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88c04849d600:19599] 0 exiting: rc = 1 00000100:00100000:1.0:1788572499.761617:0:19600:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88c052fef400:19600] 1 exiting: rc = 0 00000100:00100000:2.0:1788572499.761803:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761825:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761834:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761841:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761848:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761874:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761882:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761889:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761894:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761900:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761906:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761911:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761918:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761926:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761932:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761948:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761956:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761977:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761984:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761990:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.761996:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762001:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762007:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762013:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762019:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762026:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762032:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762039:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762047:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762070:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762077:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762084:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762090:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762097:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762103:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762110:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762124:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762130:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762136:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762143:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762149:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762172:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762179:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762186:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762193:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762199:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762205:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762211:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762216:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762222:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762229:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762235:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762241:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762284:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762293:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762300:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762306:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762311:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762317:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762322:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762328:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762334:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762339:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572499.762345:0:22561:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788572499.806700:0:22561:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788572518.549204:0:23177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788572528.586176:0:23639:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788572528.586190:0:23639:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788572528.586328:0:23639:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bf47978000 00000020:01000004:1.0:1788572528.586359:0:23639:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788572528.586367:0:23639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788572528.586388:0:23639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88c04854cd40) 00000020:00000080:1.0:1788572528.586400:0:23639:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788572528.609798:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788572528.618132:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x37:0x0] (8/32) 00100000:10000000:0.0:1788572528.618825:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788572528.618884:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 447: rc = 0 00100000:10000000:0.0:1788572528.618964:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 447: rc = 0 00100000:10000000:0.0:1788572528.619072:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 447: rc = 0 00100000:10000000:0.0:1788572528.619145:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 447: rc = 0 00100000:10000000:0.0:1788572528.619218:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 447: rc = 0 00100000:10000000:0.0:1788572528.619328:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 447: rc = 0 00100000:10000000:0.0:1788572528.619803:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 449: rc = 0 00100000:10000000:0.0:1788572528.621146:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:0.0:1788572528.621274:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:0.0:1788572528.622084:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 158: rc = 0 00100000:10000000:0.0:1788572528.622635:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 158: rc = 0 00100000:10000000:0.0:1788572528.622897:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 158: rc = 0 00100000:10000000:0.0:1788572528.623129:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 158: rc = 0 00100000:10000000:0.0:1788572528.623670:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 158: rc = 0 00100000:10000000:0.0:1788572528.623925:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 158: rc = 0 00100000:10000000:0.0:1788572528.624163:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 158: rc = 0 00100000:10000000:0.0:1788572528.624865:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 158: rc = 0 00100000:10000000:0.0:1788572528.625116:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 158: rc = 0 00100000:10000000:0.0:1788572528.625416:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 158: rc = 0 00100000:10000000:0.0:1788572528.625911:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 158: rc = 0 00100000:10000000:0.0:1788572528.626137:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 158: rc = 0 00100000:10000000:0.0:1788572528.626865:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 591: rc = 0 00100000:10000000:0.0:1788572528.627120:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 591: rc = 0 00100000:10000000:0.0:1788572528.627718:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 591: rc = 0 00100000:10000000:0.0:1788572528.627969:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 591: rc = 0 00100000:10000000:0.0:1788572528.628208:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 591: rc = 0 00100000:10000000:0.0:1788572528.628781:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 591: rc = 0 00100000:10000000:0.0:1788572528.629025:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 591: rc = 0 00100000:10000000:0.0:1788572528.629674:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 591: rc = 0 00100000:10000000:0.0:1788572528.629955:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 591: rc = 0 00100000:10000000:0.0:1788572528.630204:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 591: rc = 0 00100000:10000000:0.0:1788572528.630958:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 591: rc = 0 00100000:10000000:0.0:1788572528.631217:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 591: rc = 0 00100000:10000000:0.0:1788572528.631877:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 591: rc = 0 00100000:10000000:0.0:1788572528.632135:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 591: rc = 0 00100000:10000000:0.0:1788572528.632729:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 591: rc = 0 00100000:10000000:0.0:1788572528.632977:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 591: rc = 0 00100000:10000000:0.0:1788572528.633214:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 591: rc = 0 00100000:10000000:2.0:1788572528.633926:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 591: rc = 0 00100000:10000000:2.0:1788572528.634166:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 591: rc = 0 00100000:10000000:2.0:1788572528.634707:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 591: rc = 0 00100000:10000000:2.0:1788572528.634950:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 591: rc = 0 00100000:10000000:2.0:1788572528.635184:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 591: rc = 0 00100000:10000000:2.0:1788572528.635664:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 591: rc = 0 00100000:10000000:2.0:1788572528.635926:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 591: rc = 0 00100000:10000000:2.0:1788572528.636188:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 591: rc = 0 00100000:10000000:2.0:1788572528.637021:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 591: rc = 0 00100000:10000000:2.0:1788572528.637499:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 591: rc = 0 00100000:10000000:2.0:1788572528.637818:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 591: rc = 0 00100000:10000000:2.0:1788572528.638067:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 591: rc = 0 00100000:10000000:2.0:1788572528.638550:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 591: rc = 0 00100000:10000000:2.0:1788572528.638871:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 591: rc = 0 00100000:10000000:2.0:1788572528.639161:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 591: rc = 0 00100000:10000000:2.0:1788572528.639875:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 172: rc = 0 00100000:10000000:2.0:1788572528.640881:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788572528.641129:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 125: rc = 0 00100000:10000000:2.0:1788572528.641354:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788572528.641821:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 125: rc = 0 00100000:10000000:2.0:1788572528.642019:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788572528.642087:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 125: rc = 0 00100000:10000000:2.0:1788572528.642883:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788572528.642958:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:2.0:1788572528.643138:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788572528.643203:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:2.0:1788572528.643726:0:23639:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788572528.643798:0:23639:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00000020:00000080:2.0:1788572528.644061:0:23639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788572528.644069:0:23639:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788572528.644080:0:23639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c01916 00000020:01000004:2.0:1788572528.644089:0:23639:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788572528.644094:0:23639:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788572528.644106:0:23639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bf47978000 from MGS 00000020:01000004:2.0:1788572528.644110:0:23639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788572528.644120:0:23639:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88c0760a3380) 00000020:00000080:2.0:1788572528.644131:0:23639:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788572528.644216:0:23639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf47978000 from MGS, refs=2 00080000:01000000:2.0:1788572528.644221:0:23639:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788572528.644226:0:23639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c01924 00000100:00100000:2.0:1788572528.644826:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788572528.644961:0:23639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788572528.644967:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788572528.646021:0:23639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788572528.646031:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788572528.647044:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788572528.647214:0:23639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788572528.647221:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788572528.647999:0:23639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788572528.648007:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788572528.649032:0:23639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788572528.649038:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788572528.649533:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572528.649536:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572528.649538:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572528.649912:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572528.649914:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572528.649915:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572528.660072:0:23639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788572528.663637:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788572528.680122:0:23639:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788572528.680139:0:23639:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788572528.680141:0:23639:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788572528.682818:0:23648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788572528.683349:0:23639:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788572528.683736:0:23639:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572528.684404:0:23639:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788572528.685015:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572528.688726:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788572528.688736:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788572528.691799:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788572528.691814:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788572528.693789:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788572528.693802:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788572528.696301:0:23652:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788572528.696853:0:23639:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788572528.696879:0:23639:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:2.0:1788572528.696882:0:23639:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788572528.696913:0:23639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:2.0:1788572528.696927:0:23639:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.102@tcp (ffff88c0760a4d40) 00000020:00000080:2.0:1788572528.696952:0:23639:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788572528.697024:0:23639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c046fd7800@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788572528.698579:0:23639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:2.0:1788572528.698588:0:23639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788572528.707002:0:23653:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788572528.707387:0:23639:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid c3220b4e-982e-4e01-8588-718942d18413) 00000020:00000080:0.0:1788572528.707415:0:23639:0:(genops.c:1385:class_connect()) connect: client c3220b4e-982e-4e01-8588-718942d18413, cookie 0x977d9e7969c01932 00000100:00080000:0.0:1788572528.707428:0:23639:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572528.707434:0:23639:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import ffff88c046fd7800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572528.707476:0:23639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07f7f6d80 x1875453518442496/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572528.707511:0:23639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c3220b4e-982e-4e01-8588-718942d18413->MGS 00000020:01000004:0.0:1788572528.707536:0:23639:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788572528.707542:0:23639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788572528.707566:0:23639:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88bf47593380) 00000020:00000080:0.0:1788572528.707580:0:23639:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788572528.708393:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3220b4e-982e-4e01-8588-718942d18413:3296:1875453518442496:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788572528.708466:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.708536:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518442496 00000100:00100000:2.0:1788572528.708542:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518442496 00000100:00100000:2.0:1788572528.708592:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572528.708600:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3296:x1875453518442496:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788572528.708621:0:23649:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c3220b4e-982e-4e01-8588-718942d18413@0@lo t0 exp 0000000000000000 cur 749 last 0 00000020:00000080:2.0:1788572528.708648:0:23649:0:(genops.c:1385:class_connect()) connect: client c3220b4e-982e-4e01-8588-718942d18413, cookie 0x977d9e7969c01940 00000100:00080000:2.0:1788572528.708770:0:23649:0:(import.c:65:import_set_state_nolock()) ffff88c046fd6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572528.708822:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+5:3296:x1875453518442496:12345-0@lo:250:mount.lustre.0 Request processed in 222us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.708830:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572528.708874:0:3296:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788572528.708882:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:2.0:1788572528.708889:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788572528.708893:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788572528.708897:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c046fd7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788572528.708900:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788572528.708907:0:3296:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788572528.708912:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3220b4e-982e-4e01-8588-718942d18413:3296:1875453518442496:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788572528.717778:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572528.717974:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788572528.717981:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788572528.735061:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788572528.735076:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788572528.736172:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788572528.736181:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788572528.738954:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572528.739146:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788572528.739152:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788572528.741802:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788572528.741817:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788572528.779014:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572528.779564:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788572528.779572:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788572528.780883:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788572528.780894:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788572528.782810:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572528.782996:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788572528.783002:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788572528.783796:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788572528.783804:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788572528.784641:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572528.784818:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788572528.784823:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788572528.785536:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788572528.785545:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788572528.786150:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572528.786648:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788572528.786653:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788572528.787151:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788572528.787158:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788572528.803769:0:23639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572528.804009:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788572528.804015:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788572528.806964:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788572528.806980:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788572528.808231:0:23639:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788572528.808242:0:23639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788572528.809812:0:23639:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788572528.809838:0:23639:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788572528.809844:0:23639:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788572528.809977:0:23639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788572528.810012:0:23639:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788572528.810016:0:23639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788572528.810021:0:23639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572528.810023:0:23639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572528.810024:0:23639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572528.810025:0:23639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572528.810026:0:23639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572528.810027:0:23639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572528.810028:0:23639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572528.810029:0:23639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572528.810104:0:23639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572528.810106:0:23639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788572528.810108:0:23639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572528.810109:0:23639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572528.810110:0:23639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572528.810111:0:23639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572528.810112:0:23639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572528.810113:0:23639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572528.810113:0:23639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572528.810114:0:23639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572528.810115:0:23639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572528.810116:0:23639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572528.810144:0:23639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788572528.810231:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518442624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572528.810559:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.810645:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.810701:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518442624 00000100:00100000:2.0:1788572528.810708:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518442624 00000100:00100000:2.0:1788572528.810795:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788572528.810813:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+5:23639:x1875453518442624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572528.810865:0:23651:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788572528.810868:0:23651:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788572528.810871:0:23651:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788572528.811358:0:23673:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788572528.811730:0:23651:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 11 20000000:01000000:2.0:1788572528.813657:0:23674:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788572528.813667:0:23674:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788572528.813670:0:23674:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788572528.813712:0:23674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788572528.814375:0:23651:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572528.814387:0:23651:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788572528.827192:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+5:23639:x1875453518442624:12345-0@lo:253:mount.lustre.0 Request processed in 16370us (16623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.827213:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572528.827449:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518442624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572528.827475:0:23639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788572528.827478:0:23639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572528.827480:0:23639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572528.827481:0:23639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572528.827482:0:23639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572528.827484:0:23639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572528.827485:0:23639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572528.827500:0:23639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572528.827501:0:23639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572528.827503:0:23639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572528.827504:0:23639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788572528.827524:0:23639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bf47978000 from lustre-MDT0000 10000000:01000000:1.0:1788572528.827550:0:23639:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788572528.827552:0:23639:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788572528.827566:0:23639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88c0760a4d40 10000000:01000000:1.0:1788572528.827571:0:23639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572528.827579:0:23639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88c0760a4d40 from 1 10000000:01000000:1.0:1788572528.827582:0:23639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788572528.827625:0:23639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.827636:0:23639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.827647:0:23639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.827668:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518442752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572528.827710:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.827751:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.828125:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518442752 00000100:00100000:0.0:1788572528.828133:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518442752 00000100:00100000:0.0:1788572528.828187:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572528.828197:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+5:23639:x1875453518442752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572528.828208:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.828223:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90200/0x977d9e7969c0194e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01947 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.828290:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90200/0x977d9e7969c0194e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01947 expref: 6 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.828301:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90200/0x977d9e7969c0194e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01947 expref: 6 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.828309:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90200, rc 0) 00000100:00100000:0.0:1788572528.828357:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+6:23639:x1875453518442752:12345-0@lo:101:mount.lustre.0 Request processed in 162us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.828363:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788572528.829551:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518442752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572528.829589:0:23639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.829600:0:23639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.829676:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518442880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572528.829740:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.829785:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.830085:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518442880 00000100:00100000:0.0:1788572528.830092:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518442880 00000100:00100000:0.0:1788572528.830141:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572528.830150:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+6:23639:x1875453518442880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572528.830632:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+6:23639:x1875453518442880:12345-0@lo:501:mount.lustre.0 Request processed in 481us (890us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572528.830640:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572528.831568:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518442880:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788572528.831613:0:23639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788572528.831632:0:23639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.831644:0:23639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.831654:0:23639:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bf47978000 10000000:01000000:1.0:1788572528.831661:0:23639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788572528.831666:0:23639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88bf47978000 10000000:01000000:1.0:1788572528.831668:0:23639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788572528.831671:0:23639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88bf47978000 from 1 10000000:01000000:1.0:1788572528.831674:0:23639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788572528.831709:0:23639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.831716:0:23639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.831726:0:23639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.831746:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572528.831796:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.831834:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.832849:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518443008 00000100:00100000:0.0:1788572528.832860:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518443008 00000100:00100000:0.0:1788572528.832918:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572528.832928:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+6:23639:x1875453518443008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572528.832943:0:23649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.832960:0:23649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b91200/0x977d9e7969c0195c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01955 expref: -99 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.832986:0:23649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91200/0x977d9e7969c0195c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01955 expref: 7 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.833015:0:23649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b91200/0x977d9e7969c0195c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01955 expref: 7 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.833024:0:23649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91200, rc 0) 00000100:00100000:0.0:1788572528.833089:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+7:23639:x1875453518443008:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.833096:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572528.833197:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572528.833219:0:23639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0195c expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.833227:0:23639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0195c expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.833242:0:23639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572528.833286:0:23639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0195c expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.833293:0:23639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387600/0x977d9e7969c01955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0195c expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.833299:0:23639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788572528.833303:0:23639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572528.833308:0:23639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88bf47978000 10000000:01000000:1.0:1788572528.833311:0:23639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788572528.833313:0:23639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788572528.833315:0:23639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788572528.833346:0:23639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.833353:0:23639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.833360:0:23639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.833376:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572528.833429:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.833457:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.834348:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518443136 00000100:00100000:2.0:1788572528.834358:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518443136 00000100:00100000:2.0:1788572528.834398:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572528.834405:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+7:23639:x1875453518443136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572528.834416:0:23651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572528.834442:0:23651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0de00/0x977d9e7969c0196a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01963 expref: -99 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.834461:0:23651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0de00/0x977d9e7969c0196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01963 expref: 8 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.834470:0:23651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0de00/0x977d9e7969c0196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01963 expref: 8 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.834478:0:23651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0de00, rc 0) 00000100:00100000:2.0:1788572528.834523:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+8:23639:x1875453518443136:12345-0@lo:101:mount.lustre.0 Request processed in 118us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.834530:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788572528.835707:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572528.835733:0:23639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0196a expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.835745:0:23639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0196a expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.835821:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572528.835871:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.835907:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.836554:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518443264 00000100:00100000:2.0:1788572528.836571:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518443264 00000100:00100000:2.0:1788572528.836631:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788572528.836640:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+8:23639:x1875453518443264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572528.837052:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+9:23639:x1875453518443264:12345-0@lo:501:mount.lustre.0 Request processed in 413us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.837060:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572528.837301:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572528.837351:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572528.837398:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.837509:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518443392 00000100:00100000:0.0:1788572528.837515:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518443392 00000100:00100000:0.0:1788572528.837543:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572528.837550:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+9:23639:x1875453518443392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572528.837848:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+9:23639:x1875453518443392:12345-0@lo:503:mount.lustre.0 Request processed in 297us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.837856:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788572528.837968:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.837981:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518443392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572528.838663:0:23675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23675:1875453518443520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572528.838712:0:23675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.838738:0:23675:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.838807:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518443520 00000100:00100000:0.0:1788572528.838812:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518443520 00000100:00100000:0.0:1788572528.838842:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572528.838851:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+9:23675:x1875453518443520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572528.839917:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+9:23675:x1875453518443520:12345-0@lo:502:llog_process_th.0 Request processed in 1061us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.839927:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572528.843164:0:23675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23675:1875453518443520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572528.843233:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572528.843409:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572528.843736:0:23675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572528.843745:0:23675:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788572528.843749:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572528.843766:0:23675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88bf475e3380) 00000020:00000080:3.0:1788572528.843800:0:23675:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788572528.843808:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788572528.843904:0:23675:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788572528.843915:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c01978 00000020:00000080:3.0:1788572528.844710:0:23675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788572528.844720:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572528.844726:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572528.844728:0:23675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572528.844731:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572528.844737:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572528.844738:0:23675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788572528.844741:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572528.844752:0:23675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88bf475e0000) 00000020:00000080:3.0:1788572528.844768:0:23675:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788572528.844772:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788572528.844775:0:23675:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788572528.844778:0:23675:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788572528.844784:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572528.844838:0:23675:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf47978000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788572528.844852:0:23675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88bf475e19c0) 00000020:00000080:3.0:1788572528.844860:0:23675:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788572528.844928:0:23675:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788572528.844933:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c0198d 00000020:00000080:3.0:1788572528.845038:0:23675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788572528.845044:0:23675:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788572528.845048:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x977d9e7969c01994 00080000:01000000:3.0:1788572528.845053:0:23675:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788572528.845056:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c0199b 00010000:00010000:0.0:1788572528.954957:0:23675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788572528.955415:0:23675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 12884902005 00000001:00080000:0.0:1788572528.955845:0:23675:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788572528.956316:0:23675:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88bf47590000) 00000020:00000080:0.0:1788572528.956346:0:23675:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788572528.958388:0:23675:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788572528.958409:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c019a9 00000020:00000080:1.0:1788572528.961771:0:23675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788572528.965912:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x977d9e7969c019b0 00000020:00000080:1.0:1788572528.970355:0:23675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788572528.970369:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572528.970377:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572528.970379:0:23675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788572528.970384:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788572528.970395:0:23675:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788572528.970396:0:23675:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572528.970398:0:23675:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572528.970400:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788572528.970402:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572528.970404:0:23675:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788572528.970406:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572528.970411:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572528.970412:0:23675:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788572528.970428:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788572528.970474:0:23675:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788572528.970491:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572528.970495:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572528.970496:0:23675:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788572528.970499:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572528.970502:0:23675:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788572528.970505:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572528.970506:0:23675:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788572528.970509:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572528.970515:0:23675:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:1.0:1788572528.970542:0:23675:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788572528.970544:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572528.970569:0:23675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88c0485499c0) 00000020:00000080:1.0:1788572528.970588:0:23675:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788572528.970593:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788572528.970644:0:23675:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788572528.970649:0:23675:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788572528.970655:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c019be 00010000:00080000:1.0:1788572528.970687:0:23675:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c0508af000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788572528.970904:0:23675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788572528.971286:0:23675:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788572528.971324:0:23675:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788572528.972117:0:23675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572528.972167:0:23675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].4, 64 off8448 00000040:00080000:1.0:1788572528.972237:0:23675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].1, 64 off8256 00000040:00080000:2.0:1788572528.977154:0:23679:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788572528.977162:0:23679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x16:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788572528.980499:0:23675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572528.980515:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788572528.980558:0:23675:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788572528.980580:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c019c5 00000100:00080000:0.0:1788572528.980592:0:23675:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572528.980599:0:23675:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0508af000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572528.980634:0:23675:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07f7f4000 x1875453518443648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572528.980672:0:23675:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788572528.980733:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572528.980738:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572528.980740:0:23675:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788572528.980744:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788572528.980747:0:23675:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788572528.980749:0:23675:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572528.980750:0:23675:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572528.980752:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788572528.980755:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572528.980757:0:23675:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788572528.980759:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788572528.980763:0:23675:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788572528.980766:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572528.980768:0:23675:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788572528.980771:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788572528.980775:0:23675:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:0.0:1788572528.980800:0:23675:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788572528.980802:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572528.980813:0:23675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88bf475919c0) 00000020:00000080:0.0:1788572528.980825:0:23675:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788572528.980837:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788572528.980895:0:23675:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788572528.980901:0:23675:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788572528.980906:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c019d3 00010000:00080000:0.0:1788572528.980937:0:23675:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88bf47469000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1788572528.981148:0:23675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788572528.981394:0:23675:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788572528.981416:0:23675:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788572528.981902:0:23675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572528.981970:0:23675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].4, 64 off8448 00000040:00080000:0.0:1788572528.982051:0:23675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].1, 64 off8256 00000100:00100000:3.0:1788572528.982210:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518443648:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788572528.982290:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518443648 offset 0 length 520: 4 00000040:00080000:0.0:1788572528.990378:0:23681:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788572528.990387:0:23681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788572528.991509:0:23675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572528.991522:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788572528.991557:0:23675:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788572528.991578:0:23675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c019da 00000100:00080000:2.0:1788572528.991589:0:23675:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572528.991595:0:23675:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf47469000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572528.991633:0:23675:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04a557480 x1875453518443776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572528.991659:0:23675:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788572528.991731:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572528.991736:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572528.991738:0:23675:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788572528.991742:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572528.991745:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572528.991748:0:23675:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788572528.991751:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788572528.991753:0:23675:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788572528.991756:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572528.991759:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572528.991761:0:23675:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788572528.991763:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572528.991765:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572528.991772:0:23675:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788572528.991777:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788572528.991797:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518443776:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788572528.991810:0:23675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23675:1875453518443904:0@lo:502:llog_process_th.0 00000400:00000100:3.0:1788572528.991860:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518443776 offset 0 length 520: 4 00000100:00100000:2.0:1788572528.991892:0:23675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.991924:0:23675:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.991962:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518443904 00000100:00100000:0.0:1788572528.991969:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518443904 00000100:00100000:0.0:1788572528.992013:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788572528.992022:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+9:23675:x1875453518443904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572528.992338:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+9:23675:x1875453518443904:12345-0@lo:502:llog_process_th.0 Request processed in 305us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.992347:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572528.994624:0:23675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23675:1875453518443904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572528.994670:0:23675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572528.994680:0:23675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572528.994683:0:23675:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572528.994688:0:23675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788572528.994782:0:23639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788572528.994802:0:23639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788572528.994825:0:23639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0196a expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.994838:0:23639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969c01963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0196a expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.994847:0:23639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf47978000 from 1 10000000:01000000:1.0:1788572528.994850:0:23639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572528.994888:0:23639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.994896:0:23639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.994904:0:23639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.994924:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572528.994990:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.995030:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.995092:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444032 00000100:00100000:0.0:1788572528.995098:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444032 00000100:00100000:0.0:1788572528.995142:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572528.995152:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+9:23639:x1875453518444032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572528.995165:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.995179:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c019e1 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.995204:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 10 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.995227:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 10 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.995273:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90e00, rc 0) 00000100:00100000:0.0:1788572528.995319:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+10:23639:x1875453518444032:12345-0@lo:101:mount.lustre.0 Request processed in 168us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.995327:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788572528.995553:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572528.995567:0:23639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.995583:0:23639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.996095:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444160:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788572528.996208:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.996312:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.996397:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444160 00000100:00100000:0.0:1788572528.996403:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444160 00000100:00100000:0.0:1788572528.996433:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788572528.996440:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+10:23639:x1875453518444160:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788572528.996456:0:23649:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788572528.996462:0:23649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788572528.996536:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+10:23639:x1875453518444160:12345-0@lo:256:mount.lustre.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.996545:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572528.996836:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444160:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788572528.997564:0:23639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572528.997619:0:23639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.997633:0:23639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.997641:0:23639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf47978000 from 1 10000000:01000000:1.0:1788572528.997643:0:23639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572528.997676:0:23639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.997684:0:23639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.997694:0:23639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.997711:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572528.997755:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.997789:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.997856:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444288 00000100:00100000:0.0:1788572528.997862:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444288 00000100:00100000:0.0:1788572528.997907:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572528.997916:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+10:23639:x1875453518444288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572528.997926:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.997938:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c019ef expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.997958:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c019ef expref: 11 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.997984:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c019ef expref: 11 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.997993:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90a00, rc 0) 00000100:00100000:0.0:1788572528.998030:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518444288:12345-0@lo:101:mount.lustre.0 Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.998037:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572528.998163:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572528.998179:0:23639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.998189:0:23639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.998239:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572528.998305:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.998323:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.999680:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444416 00000100:00100000:0.0:1788572528.999693:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444416 00000100:00100000:0.0:1788572528.999744:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572528.999754:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518444416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572529.000210:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518444416:12345-0@lo:501:mount.lustre.0 Request processed in 455us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.000219:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788572529.000421:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572529.000487:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572529.000543:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572529.000583:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572529.000757:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444544 00000100:00100000:0.0:1788572529.000763:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444544 00000100:00100000:0.0:1788572529.000798:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572529.000805:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518444544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572529.000974:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518444544:12345-0@lo:503:mount.lustre.0 Request processed in 169us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.000981:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788572529.001063:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572529.001523:0:23683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23683:1875453518444672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572529.001566:0:23683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572529.001596:0:23683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052e0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572529.001676:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444672 00000100:00100000:2.0:1788572529.001681:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444672 00000100:00100000:2.0:1788572529.001708:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572529.001716:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+11:23683:x1875453518444672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572529.001953:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+11:23683:x1875453518444672:12345-0@lo:502:llog_process_th.0 Request processed in 236us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.001960:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788572529.002592:0:23683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23683:1875453518444672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572529.002689:0:23683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572529.002700:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572529.002703:0:23683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788572529.002709:0:23683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf47978000 00000020:00000080:2.0:1788572529.002711:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572529.002719:0:23683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572529.002722:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572529.002723:0:23683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788572529.002726:0:23683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572529.002728:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572529.002730:0:23683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788572529.002733:0:23683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf47978000 00000020:00000080:2.0:1788572529.002735:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572529.008364:0:23683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572529.008382:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572529.008385:0:23683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788572529.008389:0:23683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572529.008393:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572529.008394:0:23683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788572529.008400:0:23683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bf47978000 00000020:00000080:2.0:1788572529.008403:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788572529.008490:0:23683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23683:1875453518444800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572529.008584:0:23683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.008619:0:23683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572529.011435:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444800 00000100:00100000:0.0:1788572529.011452:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444800 00000100:00100000:0.0:1788572529.011516:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572529.011526:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+11:23683:x1875453518444800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572529.011813:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+11:23683:x1875453518444800:12345-0@lo:502:llog_process_th.0 Request processed in 287us (3228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.011827:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788572529.012467:0:23683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23683:1875453518444800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572529.012508:0:23683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572529.012517:0:23683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572529.012520:0:23683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788572529.012524:0:23683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788572529.021218:0:23639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788572529.021300:0:23639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572529.021324:0:23639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021347:0:23639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572529.021407:0:23639:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788572529.021410:0:23639:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bf47978000 10000000:01000000:0.0:1788572529.021413:0:23639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bf47978000 10000000:01000000:0.0:1788572529.021416:0:23639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572529.021422:0:23639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bf47978000 from 1 10000000:01000000:0.0:1788572529.021425:0:23639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572529.021466:0:23639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021474:0:23639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021485:0:23639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572529.021510:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572529.021584:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572529.021631:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572529.021658:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518444928 00000100:00100000:0.0:1788572529.021665:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518444928 00000100:00100000:0.0:1788572529.021721:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572529.021730:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518444928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572529.021743:0:23651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572529.021755:0:23651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b91a00/0x977d9e7969c01a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c019fd expref: -99 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021780:0:23651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91a00/0x977d9e7969c01a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c019fd expref: 12 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021792:0:23651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b91a00/0x977d9e7969c01a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c019fd expref: 12 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021801:0:23651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91a00, rc 0) 00000100:00100000:0.0:1788572529.021838:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:23639:x1875453518444928:12345-0@lo:101:mount.lustre.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.021845:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572529.021906:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518444928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572529.021922:0:23639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a04 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572529.021932:0:23639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a04 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572529.021979:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518445056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572529.022003:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572529.022025:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572529.022644:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445056 00000100:00100000:0.0:1788572529.022651:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445056 00000100:00100000:0.0:1788572529.022698:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572529.022706:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:23639:x1875453518445056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572529.022976:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:23639:x1875453518445056:12345-0@lo:501:mount.lustre.0 Request processed in 269us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.022984:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572529.023026:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518445056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572529.023058:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518445184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572529.023098:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572529.023123:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572529.023137:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445184 00000100:00100000:0.0:1788572529.023141:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445184 00000100:00100000:0.0:1788572529.023163:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572529.023170:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23639:x1875453518445184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572529.023359:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23639:x1875453518445184:12345-0@lo:503:mount.lustre.0 Request processed in 189us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.023366:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572529.023404:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518445184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572529.033711:0:23687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23687:1875453518445312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572529.033805:0:23687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.033888:0:23687:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572529.038494:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445312 00000100:00100000:2.0:1788572529.038507:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445312 00000100:00100000:2.0:1788572529.038719:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572529.038730:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23687:x1875453518445312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572529.039023:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23687:x1875453518445312:12345-0@lo:502:llog_process_th.0 Request processed in 294us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.039031:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788572529.039121:0:23687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23687:1875453518445312:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788572529.039194:0:23687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788572529.039212:0:23687:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88c048548000) 00000020:00000080:1.0:1788572529.039268:0:23687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788572529.039361:0:23687:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf47978000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572529.039365:0:23687:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bf47978000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572529.039368:0:23687:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf47978000 4 00010000:00080000:1.0:1788572529.039397:0:23687:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c047279800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788572529.040990:0:23687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788572529.042670:0:23687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788572529.042710:0:23687:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788572529.042724:0:23687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x977d9e7969c01a12 00000100:00080000:1.0:1788572529.042736:0:23687:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572529.042743:0:23687:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88c047279800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788572529.042784:0:23687:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf47694000 x1875453518445440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572529.042854:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518445440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572529.042941:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.043042:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445440 00000100:00100000:2.0:1788572529.043051:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445440 00000100:00100000:2.0:1788572529.043087:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572529.043095:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1875453518445440:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788572529.044420:0:23687:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788572529.044936:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1875453518445440:12345-0@lo:38:llog_process_th.0 Request processed in 1836us (1990us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788572529.044948:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572529.046887:0:23687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23687:1875453518445568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572529.046983:0:23687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572529.047023:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445568 00000100:00100000:1.0:1788572529.047031:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445568 00000100:00100000:1.0:1788572529.047078:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572529.047086:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:23687:x1875453518445568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572529.048496:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:23687:x1875453518445568:12345-0@lo:502:llog_process_th.0 Request processed in 1403us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572529.048508:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572529.048566:0:23687:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572529.048591:0:23687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3220b4e-982e-4e01-8588-718942d18413:23687:1875453518445568:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788572529.048624:0:23687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788572529.048889:0:23639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788572529.048917:0:23639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572529.048974:0:23639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a04 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.048986:0:23639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b91400/0x977d9e7969c019fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a04 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788572529.049035:0:23639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788572529.049037:0:23639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572529.049039:0:23639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572529.049040:0:23639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572529.049041:0:23639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572529.049043:0:23639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572529.049044:0:23639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572529.049045:0:23639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572529.049047:0:23639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572529.049048:0:23639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788572529.049052:0:23639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788572529.049058:0:23639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572529.049060:0:23639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572529.049061:0:23639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572529.049061:0:23639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572529.049063:0:23639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572529.049063:0:23639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572529.049064:0:23639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572529.049065:0:23639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572529.049066:0:23639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572529.049067:0:23639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788572529.049088:0:23639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788572529.049103:0:23639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518445696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572529.049145:0:23639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.049179:0:23639:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572529.049770:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445696 00000100:00100000:1.0:1788572529.049779:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445696 00000100:00100000:1.0:1788572529.049827:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788572529.049837:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23639:x1875453518445696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788572529.049861:0:23649:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788572529.049875:0:23649:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788572529.051403:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572529.051418:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c047279800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572529.051425:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572529.051429:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518445440:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788572529.109982:0:23649:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572529.110004:0:23649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788572529.110369:0:23673:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788572529.110375:0:23673:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788572529.110407:0:23673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572529.110425:0:23673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572529.110433:0:23673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572529.110504:0:23673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572529.110519:0:23673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 12 pid: 23650 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572529.110534:0:23673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23673:1875453518445824:0@lo:104: 00000100:00100000:1.0:1788572529.110609:0:23673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572529.110668:0:23673:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572529.110738:0:23640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445824 00000100:00100000:2.0:1788572529.110746:0:23640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445824 00000100:00100000:2.0:1788572529.110800:0:23640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572529.110811:0:23640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:23673:x1875453518445824:12345-0@lo:104: 00010000:00010000:2.0:1788572529.110835:0:23640:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.110902:0:23640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572529.110909:0:23640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:23673:x1875453518445824:12345-0@lo:104: Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.110916:0:23640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788572529.110938:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572529.110944:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.110951:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572529.110961:0:23646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.110970:0:23646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572529.110977:0:23646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572529.110982:0:23646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572529.111010:0:23646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111016:0:23646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572529.111036:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111043:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969c019e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c019e8 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111061:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572529.111063:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572529.111063:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518445952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572529.111064:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572529.111094:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.111181:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518445952 00000100:00100000:2.0:1788572529.111186:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518445952 00010000:00010000:2.0:1788572529.111202:0:23642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 13 pid: 23650 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572529.111232:0:23642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572529.111239:0:23642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3220b4e-982e-4e01-8588-718942d18413+13:3297:x1875453518445952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572529.111285:0:23642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788572529.111294:0:23673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23673:1875453518445824:0@lo:104: 00010000:00010000:2.0:1788572529.111296:0:23642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 13 pid: 23650 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111307:0:23642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 13 pid: 23650 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572529.111316:0:23673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111320:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90e00/0x977d9e7969c019e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c019e1 expref: 13 pid: 23650 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111343:0:23642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111351:0:23642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572529.111363:0:23642:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000989470s 00010000:00010000:2.0:1788572529.111368:0:23642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111375:0:23642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111382:0:23642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111387:0:23642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111393:0:23642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572529.111398:0:23642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111416:0:23642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111426:0:23642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572529.111436:0:23642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572529.111478:0:23673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572529.111478:0:23642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3220b4e-982e-4e01-8588-718942d18413+12:3297:x1875453518445952:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (383us total) trans 0 rc 0/0 00010000:00010000:1.0:1788572529.111485:0:23673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572529.111485:0:23642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788572529.111491:0:23673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041386e00/0x977d9e7969c01a19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572529.111547:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518445952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572529.120999:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+11:23639:x1875453518445696:12345-0@lo:253:mount.lustre.0 Request processed in 71154us (71843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572529.121016:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788572529.125574:0:23639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:23639:1875453518445696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788572529.125598:0:23639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788572529.125601:0:23639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788572529.125603:0:23639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572529.125604:0:23639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572529.125605:0:23639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572529.125606:0:23639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572529.125607:0:23639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572529.125609:0:23639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572529.125610:0:23639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572529.125612:0:23639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572529.125613:0:23639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788572529.125631:0:23639:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788572529.138201:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572529.138414:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572529.140010:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572529.140192:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572529.140885:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572529.141040:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572529.148914:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572529.149086:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572529.149415:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788572529.150655:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788572529.150955:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788572529.151114:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788572529.210222:0:23639:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8589934643 00000040:01000000:2.0:1788572529.211529:0:23639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788572529.211978:0:23695:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788572529.212066:0:23695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572529.214591:0:23695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788572529.214667:0:23695:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788572529.214681:0:23695:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788572529.217162:0:23639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788572529.217318:0:23639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788572529.217880:0:23639:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788572529.217890:0:23639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788572529.218043:0:23639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572529.219282:0:23639:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1788572529.219667:0:23694:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8589934643 00000020:00080000:3.0:1788572529.219672:0:23694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934643 00000040:00080000:2.0:1788572529.220952:0:23639:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788572529.221005:0:23639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788572529.221957:0:23639:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 2, last_idx 3 00080000:10000000:0.0:1788572529.224029:0:23639:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00000001:00000004:0.0:1788572529.240982:0:23639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000001:00080000:0.0:1788572529.295403:0:23639:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788572529.295440:0:23639:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac68c16cb988 00100000:10000000:0.0:1788572529.295449:0:23639:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788572529.296400:0:23639:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788572529.296423:0:23639:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788572529.296438:0:23639:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788572529.296466:0:23639:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788572529.713506:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572530.093730:0:23689:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788572530.093741:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572530.094145:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:2.0:1788572530.094152:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 10000000:01000000:0.0:1788572530.216315:0:23653:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788572530.216334:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf47978000 from 12 10000000:01000000:0.0:1788572530.216339:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788572530.216383:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572530.216399:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572530.216412:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572530.216438:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518446080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572530.216523:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572530.216567:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0520786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572530.216702:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446080 00000100:00100000:1.0:1788572530.216710:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446080 00000100:00100000:1.0:1788572530.216769:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788572530.216778:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+11:23653:x1875453518446080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572530.216792:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572530.216805:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01a20 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572530.216831:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572530.216842:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572530.216851:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:1.0:1788572530.216883:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518446080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572530.216899:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572530.217014:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518446080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572530.217027:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572530.217036:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572530.217091:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518446208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572530.217119:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572530.217137:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0520786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572530.217292:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446208 00000100:00100000:1.0:1788572530.217297:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446208 00000100:00100000:1.0:1788572530.217334:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788572530.217342:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518446208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572530.217358:0:23649:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572530.217373:0:23649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572530.217376:0:23649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788572530.217469:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518446208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572530.217475:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788572530.217514:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518446208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788572530.217556:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572530.217564:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572530.217572:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572530.731524:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572531.113492:0:23689:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788572531.113503:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572531.115026:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 1 00000040:00080000:2.0:1788572531.115123:0:23689:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572531.115159:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 1 00010000:00010000:2.0:1788572531.752435:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572532.777588:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.813519:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572534.381371:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572534.381379:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572534.381382:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572534.381385:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572534.381388:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788572534.381392:0:22878:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572534.381396:0:22878:0:(import.c:65:import_set_state_nolock()) ffff88c047279800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572534.381407:0:22878:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88c047279800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572534.381429:0:22878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c049ac9180 x1875453518446464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572534.382794:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572534.382821:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518446336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572534.382915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572534.382994:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518446464:0@lo:38:kworker.0 00000100:00100000:3.0:1788572534.383025:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572534.384494:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446464 00000100:00100000:0.0:1788572534.384507:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446464 00000100:00100000:0.0:1788572534.384565:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788572534.384573:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518446464:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572534.384602:0:23658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 755 last 0 00000020:00000080:0.0:1788572534.384640:0:23658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x977d9e7969c01a2e 00000004:00100000:0.0:1788572534.384655:0:23658:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572534.384818:0:23658:0:(import.c:65:import_set_state_nolock()) ffff88c07c55c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572534.384899:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875453518446464:12345-0@lo:38:kworker.0 Request processed in 325us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572534.384907:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788572534.384957:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c049ac9180 x1875453518446464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572534.384973:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 4 00000100:00080000:0.0:1788572534.384981:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788572534.384985:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788572534.384987:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c047279800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788572534.384993:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518446464:0@lo:38:kworker.0 00000100:00100000:1.0:1788572534.385655:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446336 00000100:00100000:1.0:1788572534.385663:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446336 00000100:00100000:1.0:1788572534.386189:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572534.386197:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:3297:x1875453518446336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572534.387854:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:3297:x1875453518446336:12345-0@lo:400:kworker.0 Request processed in 1648us (4930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572534.387867:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572534.388374:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518446336:0@lo:400:kworker.0 00000001:02000400:2.0:1788572534.768217:0:23938:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788572534.831052:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572535.848537:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572536.878371:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572537.896529:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572538.074130:0:24089:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce389f700 20000000:00000080:0.0:1788572538.074146:0:24089:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c07595bc00 uarg=0000000000000000 20000000:01000000:0.0:1788572538.074178:0:24089:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788572538.074185:0:24089:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788572538.074191:0:24089:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788572538.075073:0:24090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788572538.076467:0:24089:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788572538.089577:0:24089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788572538.089958:0:24089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572538.089979:0:24089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c019ef expref: 11 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572538.089989:0:24089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572538.090031:0:24089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c019ef expref: 11 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572538.090060:0:24089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c019ef expref: 11 pid: 23650 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572538.090074:0:24089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24089:1875453518446592:0@lo:104: 00000100:00100000:1.0:1788572538.090137:0:24089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572538.090194:0:24089:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0475716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572538.090309:0:23640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446592 00000100:00100000:2.0:1788572538.090318:0:23640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446592 00000100:00100000:2.0:1788572538.090374:0:23640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788572538.090384:0:23640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:24089:x1875453518446592:12345-0@lo:104: 00010000:00010000:2.0:1788572538.090398:0:23640:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572538.090470:0:23640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572538.090477:0:23640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:24089:x1875453518446592:12345-0@lo:104: Request processed in 95us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572538.090484:0:23640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788572538.090575:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572538.090582:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572538.090588:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572538.090592:0:23646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572538.090600:0:23646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572538.090615:0:23646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572538.090620:0:23646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788572538.090650:0:23646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572538.090656:0:23646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572538.090672:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572538.090679:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969c019ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c019f6 expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572538.090695:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572538.090697:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572538.090699:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572538.090729:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3220b4e-982e-4e01-8588-718942d18413:3299:1875453518446720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572538.090735:0:24089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24089:1875453518446592:0@lo:104: 00010000:00010000:1.0:1788572538.090755:0:24089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572538.090757:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572538.090924:0:23643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446720 00000100:00100000:3.0:1788572538.090930:0:23643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446720 00010000:00010000:3.0:1788572538.090951:0:23643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c019ef expref: 12 pid: 23650 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572538.090981:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572538.090990:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3220b4e-982e-4e01-8588-718942d18413+12:3299:x1875453518446720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572538.091011:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572538.091016:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c019ef expref: 12 pid: 23650 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091027:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c019ef expref: 12 pid: 23650 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091042:0:23643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90a00/0x977d9e7969c019f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c019ef expref: 12 pid: 23650 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091057:0:23643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091065:0:23643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091079:0:23643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091087:0:23643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091093:0:23643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091099:0:23643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091104:0:23643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572538.091108:0:23643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091123:0:23643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091144:0:23643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572538.091154:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572538.091202:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3220b4e-982e-4e01-8588-718942d18413+11:3299:x1875453518446720:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572538.091208:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788572538.091797:0:24089:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572538.091807:0:24089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572538.091814:0:24089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387e00/0x977d9e7969c01a35 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572538.092286:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3220b4e-982e-4e01-8588-718942d18413:3299:1875453518446720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572538.473451:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572528/real 1788572528] req@ffff88c04a557480 x1875453518443776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572538.473486:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c04a557480 x1875453518443776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572538.473499:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572528/real 1788572528] req@ffff88c07f7f4000 x1875453518443648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572538.473514:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c07f7f4000 x1875453518443648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572538.473533:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572538.473554:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788572538.473559:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518443776:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788572538.473568:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0508af000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572538.473575:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788572538.473578:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518443648:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788572538.473648:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572538.473652:0:22878:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572538.473654:0:22878:0:(import.c:65:import_set_state_nolock()) ffff88c0508af000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572538.473660:0:22878:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 749 00000100:00080000:2.0:1788572538.473673:0:22878:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572538.473680:0:22878:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0508af000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572538.473702:0:22878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04a556680 x1875453518446976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572538.473718:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572538.473721:0:22878:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788572538.473723:0:22878:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572538.473727:0:22878:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 749 00000100:00080000:2.0:1788572538.473730:0:22878:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572538.473734:0:22878:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf47469000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572538.473744:0:22878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04a556a00 x1875453518447104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572538.473791:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518446848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572538.473865:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572538.474531:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518447232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572538.474582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572538.474630:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518446848 00000100:00100000:2.0:1788572538.474638:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518446848 00000100:00100000:2.0:1788572538.474688:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572538.474697:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+11:3300:x1875453518446848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572538.474750:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+11:3300:x1875453518446848:12345-0@lo:400:kworker.0 Request processed in 53us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572538.474757:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572538.474795:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518447232 00000100:00100000:2.0:1788572538.474799:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518447232 00000100:00100000:2.0:1788572538.474841:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572538.474849:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518447232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572538.474893:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518447232:12345-0@lo:400:kworker.0 Request processed in 44us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572538.475541:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788572538.475605:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c04a555c00 x1875453518447232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572538.475619:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518447232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572538.475648:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518446848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572538.475666:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518446976:0@lo:8:kworker.0 00000400:00000100:2.0:1788572538.475697:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518446976 offset 0 length 520: 4 00000100:00100000:2.0:1788572538.475728:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518447104:0@lo:8:kworker.0 00000400:00000100:2.0:1788572538.475751:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518447104 offset 0 length 520: 4 00010000:00010000:2.0:1788572538.927212:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788572539.688383:0:23653:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572539.688392:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf47978000 from 10 10000000:01000000:0.0:1788572539.688399:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572539.688456:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572539.688469:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572539.688505:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572539.688535:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518447360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572539.688614:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.688697:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050694900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572539.688910:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518447360 00000100:00100000:2.0:1788572539.688920:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518447360 00000100:00100000:2.0:1788572539.688984:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572539.688994:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+11:23653:x1875453518447360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572539.689010:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572539.689025:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01a3c expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572539.689051:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572539.689064:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572539.689081:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0da00, rc 0) 00000100:00100000:2.0:1788572539.689143:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518447360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572539.689149:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788572539.689305:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518447360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572539.689322:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572539.689331:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572539.689391:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518447488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572539.689431:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572539.689453:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537f7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572539.690407:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518447488 00000100:00100000:0.0:1788572539.690416:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518447488 00000100:00100000:0.0:1788572539.690518:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572539.690528:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518447488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572539.690821:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518447488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.690829:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572539.692692:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518447488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572539.692774:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518447616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572539.692849:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.710999:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572539.719651:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518447616 00000100:00100000:1.0:1788572539.719672:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518447616 00000100:00100000:1.0:1788572539.719761:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788572539.719772:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518447616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572539.720044:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:23653:x1875453518447616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (27194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572539.720052:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572539.721509:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518447616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572539.722322:0:24150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788572539.722384:0:23653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788572539.722406:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572539.722419:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572539.722443:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572539.944444:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572540.970835:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572541.353856:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788572541.993378:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572543.016981:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788572543.364999:0:24338:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788572543.365004:0:24338:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788572543.365128:0:24338:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bf4530a800 00000020:01000004:3.0:1788572543.365145:0:24338:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788572543.365159:0:24338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788572543.365174:0:24338:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88bf475e4d40) 00000020:00000080:3.0:1788572543.365190:0:24338:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788572543.432725:0:24338:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788572543.433011:0:24338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788572543.433803:0:24338:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788572543.434031:0:24338:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788572543.434245:0:24338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:2.0:1788572543.434646:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 455: rc = 0 00100000:10000000:2.0:1788572543.434747:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 455: rc = 0 00100000:10000000:2.0:1788572543.434843:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 455: rc = 0 00100000:10000000:3.0:1788572543.440996:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 689: rc = 0 00100000:10000000:3.0:1788572543.441367:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 689: rc = 0 00100000:10000000:3.0:1788572543.441998:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 689: rc = 0 00100000:10000000:3.0:1788572543.444456:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 689: rc = 0 00100000:10000000:3.0:1788572543.445030:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 689: rc = 0 00100000:10000000:3.0:1788572543.445458:0:24338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 689: rc = 0 00000020:00000080:3.0:1788572543.446717:0:24338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788572543.446729:0:24338:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572543.446741:0:24338:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x977d9e7969c01a51 00000020:01000004:3.0:1788572543.446749:0:24338:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788572543.446771:0:24338:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788572543.446775:0:24338:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788572543.446781:0:24338:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788572543.446786:0:24338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788572543.446798:0:24338:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88bf460719c0) 00000020:00000080:3.0:1788572543.446810:0:24338:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788572543.447927:0:24338:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572543.448079:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788572543.448085:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788572543.453160:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788572543.453322:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788572543.462004:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788572543.462020:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788572543.463519:0:24338:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788572543.463713:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788572543.463720:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788572543.468125:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788572543.468140:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788572543.504131:0:24338:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572543.504923:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788572543.504931:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788572543.507180:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788572543.507194:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788572543.515362:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788572543.515378:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788572543.523160:0:24338:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572543.523400:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788572543.523406:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788572543.529984:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788572543.529999:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00080000:3.0:1788572543.593299:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572543.593308:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572543.593312:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572543.593315:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788572543.593379:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518447872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572543.593458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572543.593550:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518447872 00000100:00100000:3.0:1788572543.593569:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518447872 00000100:00100000:3.0:1788572543.593617:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572543.593628:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518447872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572543.593696:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518447872:12345-0@lo:400:kworker.0 Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.593704:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788572543.593751:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c049acb480 x1875453518447872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572543.593766:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518447872:0@lo:400:kworker.0 00000100:00100000:1.0:1788572543.594023:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572543.594034:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518447744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572543.594074:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572543.594363:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518447744 00000100:00100000:3.0:1788572543.594368:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518447744 00000100:00100000:3.0:1788572543.594405:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572543.594412:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:3297:x1875453518447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572543.594456:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:3297:x1875453518447744:12345-0@lo:400:kworker.0 Request processed in 45us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.594462:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788572543.594551:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518447744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572543.619365:0:24338:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572543.619611:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788572543.619618:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788572543.625541:0:24338:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788572543.625555:0:24338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788572543.627179:0:24338:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788572543.627207:0:24338:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788572543.627214:0:24338:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788572543.673292:0:24338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788572543.673349:0:24338:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788572543.673354:0:24338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788572543.673356:0:24338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572543.673357:0:24338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572543.673359:0:24338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572543.673361:0:24338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572543.673362:0:24338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572543.673369:0:24338:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572543.673371:0:24338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572543.673372:0:24338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788572543.673376:0:24338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788572543.673379:0:24338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572543.673380:0:24338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572543.673381:0:24338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572543.673382:0:24338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572543.673383:0:24338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572543.673384:0:24338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572543.673385:0:24338:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572543.673386:0:24338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572543.673387:0:24338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788572543.673418:0:24338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788572543.673443:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448000:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572543.673555:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572543.673609:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076587e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572543.675058:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448000 00000100:00100000:1.0:1788572543.675072:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448000 00000100:00100000:1.0:1788572543.675138:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788572543.675148:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:24338:x1875453518448000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788572543.675202:0:23649:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788572543.675209:0:23649:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788572543.675213:0:23649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788572543.688699:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+12:24338:x1875453518448000:12345-0@lo:253:mount.lustre.0 Request processed in 13537us (15129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.688733:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788572543.688859:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448000:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572543.688875:0:24338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788572543.688878:0:24338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572543.688879:0:24338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572543.688880:0:24338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572543.688882:0:24338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572543.688883:0:24338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572543.688884:0:24338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572543.688896:0:24338:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572543.688898:0:24338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572543.688900:0:24338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788572543.688920:0:24338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bf4530a800 from lustre-OST0000 10000000:01000000:3.0:1788572543.688945:0:24338:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788572543.688947:0:24338:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788572543.688953:0:24338:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88c0760a4d40 local copy 00010000:00010000:3.0:1788572543.688963:0:24338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572543.689211:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572543.689313:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572543.689353:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076587b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.689484:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448128 00000100:00100000:2.0:1788572543.689490:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448128 00000100:00100000:2.0:1788572543.689543:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572543.689552:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:24338:x1875453518448128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572543.689720:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+12:24338:x1875453518448128:12345-0@lo:501:mount.lustre.0 Request processed in 168us (406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572543.689727:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788572543.690000:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448128:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788572543.690018:0:24338:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788572543.690176:0:24338:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788572543.690185:0:24338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.690206:0:24338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572543.690228:0:24338:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bf4530a800 10000000:01000000:0.0:1788572543.690233:0:24338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788572543.690237:0:24338:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88c0760a4d40 10000000:01000000:0.0:1788572543.690240:0:24338:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788572543.690243:0:24338:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88c0760a4d40 from 1 10000000:01000000:0.0:1788572543.690285:0:24338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788572543.690315:0:24338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.690324:0:24338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.690333:0:24338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572543.690347:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572543.690383:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.690419:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572543.690708:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448256 00000100:00100000:3.0:1788572543.690714:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448256 00000100:00100000:3.0:1788572543.690755:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788572543.690763:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+12:24338:x1875453518448256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572543.690775:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572543.690790:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c06c919600/0x977d9e7969c01a66 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01a5f expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572543.690811:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c06c919600/0x977d9e7969c01a66 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01a5f expref: 13 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572543.690822:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c06c919600/0x977d9e7969c01a66 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a5f expref: 13 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572543.690831:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c919600, rc 0) 00000100:00100000:3.0:1788572543.690879:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+13:24338:x1875453518448256:12345-0@lo:101:mount.lustre.0 Request processed in 117us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.690895:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788572543.691100:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572543.691114:0:24338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a66 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.691124:0:24338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a66 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572543.691140:0:24338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788572543.691156:0:24338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a66 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.691164:0:24338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90400/0x977d9e7969c01a5f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a66 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572543.691170:0:24338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788572543.691175:0:24338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572543.691179:0:24338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788572543.691181:0:24338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788572543.691197:0:24338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.691203:0:24338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.691210:0:24338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572543.691223:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572543.691311:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.691334:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.691388:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448384 00000100:00100000:2.0:1788572543.691393:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448384 00000100:00100000:2.0:1788572543.691424:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788572543.691431:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+13:24338:x1875453518448384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572543.691439:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572543.691447:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0d200/0x977d9e7969c01a74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01a6d expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.691461:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0d200/0x977d9e7969c01a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01a6d expref: 14 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.691469:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0d200/0x977d9e7969c01a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a6d expref: 14 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.691476:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d200, rc 0) 00000100:00100000:2.0:1788572543.691518:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448384:12345-0@lo:101:mount.lustre.0 Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.691532:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788572543.691763:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572543.691775:0:24338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a74 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.691782:0:24338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a74 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572543.693420:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:2.0:1788572543.695427:0:24338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572543.695716:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788572543.695760:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:2.0:1788572543.695794:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:2.0:1788572543.695838:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:2.0:1788572543.695872:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:2.0:1788572543.695919:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:2.0:1788572543.695962:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:2.0:1788572543.695993:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:2.0:1788572543.696039:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:2.0:1788572543.696086:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:2.0:1788572543.696123:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:2.0:1788572543.696171:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:2.0:1788572543.696233:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:2.0:1788572543.696240:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:2.0:1788572543.696393:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572543.696465:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572543.696506:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050343240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572543.699586:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448512 00000100:00100000:0.0:1788572543.699604:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448512 00000100:00100000:0.0:1788572543.699685:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788572543.699696:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572543.700186:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448512:12345-0@lo:501:mount.lustre.0 Request processed in 491us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.700195:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788572543.700933:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572543.700997:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572543.701062:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.701105:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.701360:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448640 00000100:00100000:2.0:1788572543.701367:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448640 00000100:00100000:2.0:1788572543.701414:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788572543.701424:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572543.702390:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448640:12345-0@lo:503:mount.lustre.0 Request processed in 963us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.702400:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572543.702766:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788572543.708166:0:24338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572543.709961:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572543.710076:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.710124:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.710938:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448768 00000100:00100000:2.0:1788572543.710948:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448768 00000100:00100000:2.0:1788572543.711007:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788572543.711016:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572543.711333:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448768:12345-0@lo:502:mount.lustre.0 Request processed in 317us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.711342:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572543.711918:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572543.712181:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788572543.712240:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:1.0:1788572543.712316:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:1.0:1788572543.712367:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:1.0:1788572543.712405:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:1.0:1788572543.712439:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:1.0:1788572543.712486:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:1.0:1788572543.712719:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:1.0:1788572543.712756:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:1.0:1788572543.712807:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:1.0:1788572543.712843:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:1.0:1788572543.712956:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:1.0:1788572543.713005:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572543.713083:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.713137:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.717230:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518448896 00000100:00100000:2.0:1788572543.717290:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518448896 00000100:00100000:2.0:1788572543.717354:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572543.717366:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572543.717738:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518448896:12345-0@lo:502:mount.lustre.0 Request processed in 373us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.717748:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788572543.718492:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518448896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572543.718670:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:1.0:1788572543.718687:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788572543.724949:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572543.724966:0:24352:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788572543.724973:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572543.724976:0:24352:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788572543.724984:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572543.725000:0:24352:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88bf46074d40) 00000020:00000080:3.0:1788572543.725026:0:24352:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788572543.725033:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572543.725111:0:24352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf4530a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788572543.725118:0:24352:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788572543.725130:0:24352:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x977d9e7969c01a82 00010000:00010000:3.0:1788572543.732651:0:24352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788572543.733119:0:24352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901897 00080000:10000000:2.0:1788572543.750201:0:24352:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:2.0:1788572543.752160:0:24352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788572543.752173:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572543.752180:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572543.752182:0:24352:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788572543.752185:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788572543.752188:0:24352:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788572543.752189:0:24352:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572543.752190:0:24352:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572543.752191:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788572543.752193:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572543.752195:0:24352:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788572543.752197:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572543.752200:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572543.752201:0:24352:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788572543.752204:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788572543.752206:0:24352:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788572543.752208:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572543.752210:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572543.752211:0:24352:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788572543.752220:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572543.752223:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572543.752224:0:24352:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788572543.752227:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788572543.752339:0:24352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572543.752343:0:24352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572543.752345:0:24352:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572543.752349:0:24352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000020:01000000:0.0:1788572543.752538:0:24338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788572543.752569:0:24338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788572543.752591:0:24338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a74 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.752603:0:24338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c01a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a74 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572543.752611:0:24338:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf4530a800 from 1 10000000:01000000:0.0:1788572543.752614:0:24338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572543.752650:0:24338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.752658:0:24338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.752669:0:24338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572543.752696:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572543.752783:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.752829:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.752980:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449024 00000100:00100000:2.0:1788572543.752988:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449024 00000100:00100000:2.0:1788572543.753106:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572543.753119:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+14:24338:x1875453518449024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572543.753133:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572543.753148:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01a89 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.753174:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 15 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.753185:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 15 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.753191:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0dc00, rc 0) 00000100:00100000:2.0:1788572543.753224:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449024:12345-0@lo:101:mount.lustre.0 Request processed in 110us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.753229:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572543.753423:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572543.753438:0:24338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.753447:0:24338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572543.754198:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:0.0:1788572543.755416:0:24338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572543.756426:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:0.0:1788572543.756477:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:0.0:1788572543.758464:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:0.0:1788572543.758794:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:0.0:1788572543.758835:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:0.0:1788572543.758890:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:0.0:1788572543.758930:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9536 00000040:00080000:0.0:1788572543.758965:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 128 off9664 00000040:00080000:0.0:1788572543.759374:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:0.0:1788572543.759385:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:0.0:1788572543.760099:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572543.760185:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.761457:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.762747:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449152 00000100:00100000:2.0:1788572543.762761:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449152 00000100:00100000:2.0:1788572543.762864:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572543.762878:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572543.763210:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449152:12345-0@lo:501:mount.lustre.0 Request processed in 335us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.763218:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788572543.763854:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572543.763908:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572543.763963:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.766493:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.766700:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449280 00000100:00100000:2.0:1788572543.766711:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449280 00000100:00100000:2.0:1788572543.766758:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572543.766768:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572543.766986:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449280:12345-0@lo:503:mount.lustre.0 Request processed in 219us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.766995:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788572543.767183:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449280:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572543.769339:0:24338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572543.769429:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572543.769523:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.769714:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572543.771143:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449408 00000100:00100000:2.0:1788572543.771158:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449408 00000100:00100000:2.0:1788572543.771210:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572543.771220:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572543.771623:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449408:12345-0@lo:502:mount.lustre.0 Request processed in 404us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.771632:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788572543.775690:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572543.776081:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:0.0:1788572543.776145:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:0.0:1788572543.776223:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:0.0:1788572543.776310:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:0.0:1788572543.776347:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000040:00080000:0.0:1788572543.776412:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:0.0:1788572543.776451:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9536 00000040:00080000:0.0:1788572543.776847:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 128 off9664 00000100:00100000:0.0:1788572543.776895:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572543.776978:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.777197:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572543.777945:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449536 00000100:00100000:1.0:1788572543.777956:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449536 00000100:00100000:0.0:1788572543.778351:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788572543.778362:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572543.779391:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449536:12345-0@lo:502:mount.lustre.0 Request processed in 1025us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.779402:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788572543.779653:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572543.779843:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:1.0:1788572543.779858:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788572543.781413:0:24356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572543.781424:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572543.781426:0:24356:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788572543.781432:0:24356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf4530a800 00000020:00000080:1.0:1788572543.781434:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572543.781441:0:24356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572543.781443:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572543.781444:0:24356:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788572543.781446:0:24356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572543.781448:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572543.781450:0:24356:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788572543.781453:0:24356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf4530a800 00000020:00000080:1.0:1788572543.781463:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572543.781769:0:24356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572543.781774:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572543.781776:0:24356:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788572543.781779:0:24356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572543.781783:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572543.781785:0:24356:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788572543.781789:0:24356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bf4530a800 00000020:00000080:1.0:1788572543.781791:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572543.781835:0:24356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572543.781838:0:24356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572543.781839:0:24356:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788572543.781842:0:24356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000020:01000000:0.0:1788572543.784344:0:24338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788572543.784389:0:24338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572543.785799:0:24338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.785829:0:24338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572543.785918:0:24338:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788572543.785921:0:24338:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bf4530a800 10000000:01000000:0.0:1788572543.785924:0:24338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bf4530a800 10000000:01000000:0.0:1788572543.785929:0:24338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572543.785935:0:24338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bf4530a800 from 1 10000000:01000000:0.0:1788572543.785938:0:24338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572543.785975:0:24338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.785984:0:24338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.786003:0:24338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572543.786038:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572543.786107:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.786159:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572543.786541:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449664 00000100:00100000:3.0:1788572543.786552:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449664 00000100:00100000:3.0:1788572543.786618:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788572543.786628:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518449664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572543.786641:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572543.786656:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c06c918c00/0x977d9e7969c01a9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01a97 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572543.786682:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c06c918c00/0x977d9e7969c01a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01a97 expref: 16 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572543.786694:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c06c918c00/0x977d9e7969c01a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a97 expref: 16 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572543.786703:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c06c918c00, rc 0) 00000100:00100000:3.0:1788572543.786751:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518449664:12345-0@lo:101:mount.lustre.0 Request processed in 125us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.786757:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788572543.787507:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572543.787527:0:24338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a9e expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.787549:0:24338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01a9e expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572543.788154:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:0.0:1788572543.789789:0:24338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572543.790122:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788572543.790171:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:0.0:1788572543.790204:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:0.0:1788572543.790279:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:0.0:1788572543.792799:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:0.0:1788572543.792920:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:0.0:1788572543.792956:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:0.0:1788572543.792989:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:0.0:1788572543.793038:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788572543.793076:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:0.0:1788572543.793111:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:0.0:1788572543.793161:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:0.0:1788572543.793216:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:0.0:1788572543.793295:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:0.0:1788572543.794578:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:0.0:1788572543.794625:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:0.0:1788572543.794663:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:0.0:1788572543.794713:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:0.0:1788572543.794750:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:0.0:1788572543.794783:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:0.0:1788572543.794833:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:0.0:1788572543.794871:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:0.0:1788572543.794904:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:0.0:1788572543.794950:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:0.0:1788572543.794984:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:0.0:1788572543.795017:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:0.0:1788572543.795065:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:0.0:1788572543.795103:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:0.0:1788572543.795156:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:0.0:1788572543.795206:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:0.0:1788572543.795240:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:0.0:1788572543.797936:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:0.0:1788572543.797987:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:0.0:1788572543.798061:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:0.0:1788572543.798099:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:0.0:1788572543.798149:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:0.0:1788572543.798182:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:0.0:1788572543.798212:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:0.0:1788572543.798281:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:0.0:1788572543.799463:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:0.0:1788572543.799721:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:0.0:1788572543.799730:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:0.0:1788572543.799834:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572543.799906:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.799956:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449792 00000100:00100000:0.0:1788572543.799969:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449792 00000100:00100000:0.0:1788572543.800016:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788572543.800025:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518449792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572543.800244:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518449792:12345-0@lo:501:mount.lustre.0 Request processed in 218us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.800289:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788572543.801445:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572543.801483:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572543.801546:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572543.801603:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.801637:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518449920 00000100:00100000:0.0:1788572543.801642:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518449920 00000100:00100000:0.0:1788572543.801684:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788572543.801692:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518449920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572543.801870:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518449920:12345-0@lo:503:mount.lustre.0 Request processed in 178us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.801878:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788572543.801916:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572543.801931:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518449920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572543.802487:0:24338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572543.802560:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518450048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572543.802604:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.802638:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450048 00000100:00100000:0.0:1788572543.802643:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450048 00000100:00100000:0.0:1788572543.802674:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572543.802682:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518450048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572543.802871:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518450048:12345-0@lo:502:mount.lustre.0 Request processed in 189us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.802878:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572543.802933:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572543.802953:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518450048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572543.803176:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788572543.803221:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:0.0:1788572543.806503:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:0.0:1788572543.806746:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:0.0:1788572543.806789:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:0.0:1788572543.806841:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:0.0:1788572543.806877:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:0.0:1788572543.806911:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:0.0:1788572543.806963:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788572543.806999:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:0.0:1788572543.807032:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:0.0:1788572543.807079:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:0.0:1788572543.807114:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:0.0:1788572543.807149:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:0.0:1788572543.807193:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:0.0:1788572543.807227:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:0.0:1788572543.812587:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:0.0:1788572543.812696:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:0.0:1788572543.812735:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:0.0:1788572543.812769:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:0.0:1788572543.812820:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:0.0:1788572543.812855:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:0.0:1788572543.812887:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:0.0:1788572543.812935:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:0.0:1788572543.812968:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:0.0:1788572543.813012:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:0.0:1788572543.813063:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:0.0:1788572543.813098:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:0.0:1788572543.813127:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:0.0:1788572543.813166:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:0.0:1788572543.813196:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:0.0:1788572543.813225:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:0.0:1788572543.813324:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:0.0:1788572543.813709:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:0.0:1788572543.813748:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:0.0:1788572543.813794:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:0.0:1788572543.813827:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:0.0:1788572543.813859:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:0.0:1788572543.813906:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:0.0:1788572543.813932:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:0.0:1788572543.813975:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518450176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572543.814052:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.814099:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572543.814099:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450176 00000100:00100000:1.0:1788572543.814106:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450176 00000100:00100000:1.0:1788572543.814157:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572543.814167:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518450176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572543.814433:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518450176:12345-0@lo:502:mount.lustre.0 Request processed in 267us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572543.814441:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788572543.814616:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518450176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572543.814761:0:24338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:2.0:1788572543.814773:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788572543.819031:0:24361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788572543.819051:0:24361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88c04854b380) 00000020:00000080:1.0:1788572543.819077:0:24361:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788572543.819160:0:24361:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf4530a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788572543.819167:0:24361:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bf4530a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788572543.819169:0:24361:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf4530a800 3 00010000:00080000:1.0:1788572543.819201:0:24361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c07b6d5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788572543.826132:0:24361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788572543.832955:0:24361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788572543.833002:0:24361:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788572543.833022:0:24361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x977d9e7969c01aac 00000100:00080000:1.0:1788572543.833035:0:24361:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572543.833042:0:24361:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88c07b6d5000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788572543.833080:0:24361:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf47695c00 x1875453518450304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572543.833111:0:24361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788572543.833206:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518450304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788572543.833310:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572543.833375:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450304 00000100:00100000:2.0:1788572543.833382:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450304 00000100:00100000:2.0:1788572543.833413:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572543.833421:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518450304:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788572543.833452:0:23658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:2.0:1788572543.833482:0:23658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x977d9e7969c01ab3 00000004:00100000:2.0:1788572543.833496:0:23658:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572543.833767:0:23658:0:(import.c:65:import_set_state_nolock()) ffff88c07c542000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788572543.833912:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572543.833918:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572543.833920:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572543.833923:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788572543.834173:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000100:00100000:2.0:1788572543.834377:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875453518450304:12345-0@lo:38:llog_process_th.0 Request processed in 953us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.834387:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788572543.835136:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88bf47695c00 x1875453518450304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572543.835148:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788572543.835158:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 4 00000100:00080000:2.0:1788572543.835168:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788572543.835174:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788572543.835178:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788572543.835184:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518450304:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788572543.846907:0:24338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788572543.846956:0:24338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572543.847071:0:24338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a9e expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.847085:0:24338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b91800/0x977d9e7969c01a97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01a9e expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788572543.847156:0:24338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788572543.847158:0:24338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572543.847160:0:24338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572543.847161:0:24338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572543.847162:0:24338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572543.847163:0:24338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572543.847165:0:24338:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572543.847167:0:24338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572543.847168:0:24338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572543.847171:0:24338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788572543.847173:0:24338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572543.847175:0:24338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572543.847176:0:24338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572543.847177:0:24338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572543.847178:0:24338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572543.847179:0:24338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572543.847180:0:24338:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572543.847181:0:24338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572543.847182:0:24338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572543.847212:0:24338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788572543.847232:0:24338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518450432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572543.847391:0:24338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572543.847431:0:24338:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572543.848062:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450432 00000100:00100000:1.0:1788572543.848074:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450432 00000100:00100000:1.0:1788572543.848127:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788572543.848139:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:24338:x1875453518450432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788572543.848175:0:23650:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788572543.848194:0:23650:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788572543.937971:0:23650:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572543.937998:0:23650:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788572543.939171:0:23673:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788572543.939179:0:23673:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788572543.939229:0:23673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.939292:0:23673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 16 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.939302:0:23673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.939349:0:23673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 16 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.939365:0:23673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 16 pid: 23650 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572543.939403:0:23673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23673:1875453518450560:0@lo:104: 00000100:00100000:1.0:1788572543.939473:0:23673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.939539:0:23673:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572543.940143:0:23640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450560 00000100:00100000:0.0:1788572543.940153:0:23640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450560 00000100:00100000:0.0:1788572543.940214:0:23640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572543.940225:0:23640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:23673:x1875453518450560:12345-0@lo:104: 00010000:00010000:0.0:1788572543.940241:0:23640:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572543.940428:0:23673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23673:1875453518450560:0@lo:104: 00010000:00010000:1.0:1788572543.940448:0:23673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572543.941154:0:23640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572543.941165:0:23640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:23673:x1875453518450560:12345-0@lo:104: Request processed in 941us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.941193:0:23640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788572543.946849:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572543.946863:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.946875:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572543.946879:0:23646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.946890:0:23646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572543.946911:0:23646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572543.946916:0:23646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572543.946972:0:23646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.946980:0:23646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788572543.947184:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518450688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572543.947284:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.947385:0:23644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450688 00000100:00100000:1.0:1788572543.947393:0:23644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450688 00010000:00010000:1.0:1788572543.947422:0:23644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 17 pid: 23650 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572543.947454:0:23644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788572543.947464:0:23644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3220b4e-982e-4e01-8588-718942d18413+17:3300:x1875453518450688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572543.947509:0:23644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572543.947515:0:23644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 17 pid: 23650 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947537:0:23644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 17 pid: 23650 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947553:0:23644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041386800/0x977d9e7969c01a27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c01a20 expref: 17 pid: 23650 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947571:0:23644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947580:0:23644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788572543.947606:0:23644:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008427991s 00010000:00010000:1.0:1788572543.947611:0:23644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947618:0:23644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947624:0:23644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947631:0:23644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947636:0:23644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572543.947640:0:23644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947648:0:23644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947664:0:23644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.947686:0:23644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572543.947755:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.947763:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90000/0x977d9e7969c01a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a27 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572543.947778:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572543.947780:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572543.947782:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572543.957068:0:23644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3220b4e-982e-4e01-8588-718942d18413+16:3300:x1875453518450688:12345-0@lo:103:ldlm_bl.0 Request processed in 9596us (9775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572543.957083:0:23644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788572543.957126:0:23673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.957160:0:23673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572543.957168:0:23673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387200/0x977d9e7969c01aba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572543.959021:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518450688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572543.974439:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+15:24338:x1875453518450432:12345-0@lo:253:mount.lustre.0 Request processed in 126291us (127038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572543.974456:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788572543.974661:0:24338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:24338:1875453518450432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572543.974756:0:24338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788572543.974759:0:24338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572543.974761:0:24338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572543.974762:0:24338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572543.974764:0:24338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572543.974765:0:24338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572543.974766:0:24338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572543.974768:0:24338:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572543.974770:0:24338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572543.974771:0:24338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572543.974786:0:24338:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788572543.975976:0:24338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788572543.977007:0:24338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788572543.977197:0:24338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788572543.977776:0:24338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788572543.978945:0:24338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788572543.979183:0:24338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788572543.981161:0:24338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869184 00010000:00010000:1.0:1788572544.048011:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788572544.152832:0:24338:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788572544.152841:0:24338:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788572544.152877:0:24338:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788572544.152934:0:24338:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788572544.152947:0:24338:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788572544.152976:0:24338:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788572545.066721:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788572545.256430:0:23653:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788572545.256438:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf47978000 from 13 10000000:01000000:1.0:1788572545.256444:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572545.256489:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572545.256500:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572545.256512:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572545.256536:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518450816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572545.256610:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.256675:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05b1cfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572545.256824:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450816 00000100:00100000:2.0:1788572545.256833:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450816 00000100:00100000:2.0:1788572545.256892:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788572545.256902:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+15:23653:x1875453518450816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572545.256916:0:23649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572545.256931:0:23649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01ac1 expref: -99 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572545.256971:0:23649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 16 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572545.256981:0:23649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 16 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572545.256990:0:23649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d400, rc 0) 00000100:00100000:2.0:1788572545.257030:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:23653:x1875453518450816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572545.257037:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788572545.257119:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518450816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572545.257142:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572545.257151:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572545.257198:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518450944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572545.257229:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.257284:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05b1cfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572545.257437:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518450944 00000100:00100000:2.0:1788572545.257442:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518450944 00000100:00100000:2.0:1788572545.257476:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788572545.257483:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:23653:x1875453518450944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572545.257495:0:23650:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572545.257511:0:23650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572545.257514:0:23650:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788572545.257589:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:23653:x1875453518450944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572545.257596:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572545.257664:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518450944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788572545.257720:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572545.257726:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572545.257735:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572546.088422:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572547.119720:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572548.136580:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572549.160478:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572549.224383:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572549.224390:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572549.224393:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572549.224396:0:22878:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788572549.224451:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518451200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.224524:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572549.224575:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572549.224582:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518451072:0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.224613:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572549.224646:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518451328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.224674:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572549.224712:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451200 00000100:00100000:0.0:1788572549.224720:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451200 00000100:00100000:0.0:1788572549.224762:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451328 00000100:00100000:0.0:1788572549.224765:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451328 00000100:00100000:0.0:1788572549.224799:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572549.224808:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518451200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.224859:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518451200:12345-0@lo:400:kworker.0 Request processed in 51us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572549.224866:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572549.224883:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572549.224889:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518451328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.224917:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518451328:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572549.224923:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572549.224940:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451072 00000100:00100000:0.0:1788572549.224944:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451072 00000100:00100000:0.0:1788572549.224966:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572549.224972:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:3298:x1875453518451072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.224998:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:3298:x1875453518451072:12345-0@lo:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572549.225014:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788572549.225068:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c07f7f6300 x1875453518451328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572549.225081:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518451328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572549.225107:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518451072:0@lo:400:kworker.0 00010000:00080000:0.0:1788572549.225116:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c07f7f7800 x1875453518451200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572549.225125:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518451200:0@lo:400:kworker.0 00000100:00080000:3.0:1788572549.227492:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572550.184684:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572551.210487:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788572551.609487:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788572552.233426:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572552.289536:0:24705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788572553.064395:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572538/real 1788572538] req@ffff88c04a556680 x1875453518446976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572553.064435:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c04a556680 x1875453518446976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572553.064446:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572538/real 1788572538] req@ffff88c04a556a00 x1875453518447104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572553.064457:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c04a556a00 x1875453518447104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572553.064477:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0508af000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572553.064506:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788572553.064511:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518446976:0@lo:8:kworker.0 00000100:00080000:0.0:1788572553.064518:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572553.064523:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788572553.064542:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518447104:0@lo:8:kworker.0 00000100:00080000:2.0:1788572553.064688:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572553.064692:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572553.064695:0:36:0:(import.c:65:import_set_state_nolock()) ffff88c0508af000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572553.064699:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 759 00000100:00080000:2.0:1788572553.064709:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572553.064715:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0508af000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572553.064732:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04a554700 x1875453518451584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572553.064749:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572553.064752:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788572553.064754:0:36:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572553.064757:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 759 00000100:00080000:2.0:1788572553.064759:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572553.064763:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf47469000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572553.064773:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04a557100 x1875453518451712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572553.064817:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518451840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.064875:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572553.064926:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572553.064933:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.064956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.065019:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518451584:0@lo:8:kworker.0 00000100:00100000:3.0:1788572553.065051:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.065083:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518451712:0@lo:8:kworker.0 00000100:00100000:3.0:1788572553.065101:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.065169:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572553.065179:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3220b4e-982e-4e01-8588-718942d18413:3299:1875453518451456:0@lo:400:kworker.0 00000100:00100000:1.0:1788572553.065212:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.065316:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451584 00000100:00100000:1.0:1788572553.065323:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451584 00000100:00100000:1.0:1788572553.065358:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451712 00000100:00100000:1.0:1788572553.065362:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451712 00000100:00100000:1.0:1788572553.065375:0:24341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572553.065383:0:24341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3296:x1875453518451584:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788572553.065413:0:24341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:1.0:1788572553.065441:0:24341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c01acf 00002000:00100000:1.0:1788572553.065455:0:24341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88c07b6d4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788572553.065459:0:24341:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788572553.065462:0:24341:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572553.065786:0:24341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572553.065811:0:24341:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572553.065866:0:24341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1875453518451584:12345-0@lo:8:kworker.0 Request processed in 482us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.065872:0:24341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572553.065893:0:24341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572553.065898:0:24341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3296:x1875453518451712:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788572553.065909:0:24341:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572553.067159:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451456 00000100:00100000:3.0:1788572553.067170:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451456 00000100:00100000:3.0:1788572553.067226:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788572553.067287:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:3299:x1875453518451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.067356:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:3299:x1875453518451456:12345-0@lo:400:kworker.0 Request processed in 72us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.067363:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788572553.067561:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451840 00000100:00100000:0.0:1788572553.067566:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451840 00000100:00100000:0.0:1788572553.067602:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518451968 00000100:00100000:0.0:1788572553.067605:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518451968 00000100:00100000:0.0:1788572553.067630:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572553.067636:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518451840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572553.067678:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518451840:12345-0@lo:400:kworker.0 Request processed in 42us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.067684:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572553.067699:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572553.067704:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518451968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572553.067733:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518451968:12345-0@lo:400:kworker.0 Request processed in 27us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.067739:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788572553.067757:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788572553.067789:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04a556d80 x1875453518451968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572553.067804:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518451968:0@lo:400:kworker.0 00010000:00080000:0.0:1788572553.067815:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04a555f80 x1875453518451840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572553.067822:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518451840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572553.079078:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3220b4e-982e-4e01-8588-718942d18413:3299:1875453518451456:0@lo:400:kworker.0 00010000:00080000:1.0:1788572553.079138:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04a554700 x1875453518451584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572553.079150:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572553.079218:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1788572553.079237:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572553.079243:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788572553.079564:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0508af000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788572553.079597:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572553.079602:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518451584:0@lo:8:kworker.0 00000100:00100000:1.0:1788572553.079678:0:24341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3296:x1875453518451712:12345-0@lo:8:kworker.0 Request processed in 13779us (14576us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572553.079686:0:24341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1788572553.079774:0:23679:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572553.079821:0:23680:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x43:0x0] 00000004:00080000:2.0:1788572553.080081:0:23679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773870831941ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788572553.080115:0:23680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23680:1875453518452224:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572553.080154:0:23680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572553.080173:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572553.080180:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572553.080184:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518451712:0@lo:8:kworker.0 00000100:00100000:0.0:1788572553.080194:0:23680:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04136d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572553.080209:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572553.080216:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518452096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572553.080288:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452224 00000100:00100000:2.0:1788572553.080303:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452224 00000100:00100000:0.0:1788572553.080397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.081407:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452096 00000100:00100000:1.0:1788572553.081413:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452096 00000100:00100000:1.0:1788572553.081446:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572553.081452:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518452096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572553.081482:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572553.085938:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518452096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4476us (5532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.085954:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788572553.087349:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c07f7f7800 x1875453518452096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572553.087375:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518452096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572553.088972:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572553.089727:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572553.089741:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23680:x1875453518452224:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788572553.092046:0:24340:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788572553.092055:0:24340:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -30 00002000:02000040:3.0:1788572553.092060:0:24340:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:68 to 0x240000400:97) 00002000:00010000:3.0:1788572553.102018:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.102032:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102049:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x61:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.102054:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.102061:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102079:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102089:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102108:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102128:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.102142:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.102147:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102156:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.102160:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102170:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102188:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102196:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a3bfe7/0x977d9e7969c01ad6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102214:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.102216:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.102218:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.102700:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.102713:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102722:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x60:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.102726:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.102730:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102740:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102748:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102755:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102771:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.102780:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.102785:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102791:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.102806:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102814:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102831:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 1/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102838:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dacb2211/0x977d9e7969c01add lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.102851:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.102853:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.102854:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.103218:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.103236:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103244:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5f:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.103271:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.103275:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103284:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103292:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103298:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103323:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.103330:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.103334:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103340:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.103343:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103350:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103360:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103367:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000214ce5a8/0x977d9e7969c01ae4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103380:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.103381:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.103383:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.103752:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.103758:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103766:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5e:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.103775:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.103779:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103789:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103797:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103804:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103818:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.103826:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.103829:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103836:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.103840:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103847:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103856:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103872:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dc46050/0x977d9e7969c01aeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.103886:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.103887:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.103889:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.104341:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.104347:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104355:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5d:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.104358:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.104362:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104371:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104378:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104385:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104398:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.104406:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.104417:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104423:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.104426:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104433:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104443:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104449:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a84ce4/0x977d9e7969c01af2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104461:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.104462:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.104464:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.104840:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.104846:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104855:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5c:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.104858:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.104863:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104882:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104890:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104898:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104910:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.104919:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.104923:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104930:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.104933:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104942:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104952:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104960:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2098502/0x977d9e7969c01af9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.104978:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.104980:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.104982:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.106785:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.106797:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106811:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5b:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.106815:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.106820:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106833:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106844:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106852:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106867:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.106877:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.106881:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106900:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.106904:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106912:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106926:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106933:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006211ff9d/0x977d9e7969c01b00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.106949:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.106951:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.106952:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.107528:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.107534:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107542:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5a:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.107545:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.107549:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107560:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107574:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107581:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107593:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.107601:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.107605:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107611:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.107615:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107624:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107635:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107643:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b446fb70/0x977d9e7969c01b07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.107656:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.107662:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.107664:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.108047:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.108052:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108061:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x59:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.108064:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.108068:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108076:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108084:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108089:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108102:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.108109:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.108112:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108118:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.108121:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108138:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108147:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108154:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dfb78a8/0x977d9e7969c01b0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108166:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.108167:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.108168:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.108848:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.108855:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108865:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x58:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.108869:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.108873:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108883:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108892:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108905:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108919:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.108928:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.108931:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108938:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.108941:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108950:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108962:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108969:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfac5aea/0x977d9e7969c01b15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.108981:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.108983:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.108984:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.109693:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.109705:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.109715:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x57:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.109718:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.109722:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.109732:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.109740:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.109747:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.109772:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572553.110364:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572553.110370:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.110378:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.110381:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.110389:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.110415:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.110421:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f837c15f/0x977d9e7969c01b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.110437:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.110439:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.110442:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.111082:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.111090:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.111100:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x56:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.111104:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.111108:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.111119:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.111134:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.111141:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.111155:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572553.111290:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572553.111295:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.111304:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c919a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.111308:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.111317:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.111327:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.111334:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d545db44/0x977d9e7969c01b23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.111357:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.111359:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.111360:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.113032:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.113042:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113053:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.113058:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.113064:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113077:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113086:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113094:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113124:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.113135:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.113141:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113148:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c06c918800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.113152:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113160:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113173:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113180:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c8cd23a/0x977d9e7969c01b2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113197:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.113199:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.113201:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.113736:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.113742:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113751:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.113760:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.113764:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113773:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113781:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113787:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113802:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.113811:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.113814:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113820:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.113823:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113829:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113838:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113854:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c01b31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.113866:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.113868:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.113869:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572553.114426:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.114433:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.114441:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x53:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.114444:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.114448:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.114527:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.114537:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.114543:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.114597:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572553.115012:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.115023:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.115032:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x52:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.115036:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.115040:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.115048:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.115056:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.115063:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117687:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572553.117701:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117715:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.117720:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117731:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117751:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117759:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002439fb10/0x977d9e7969c01b38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117778:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572553.117781:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117788:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.117799:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117806:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117816:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.117823:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.117825:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.117827:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.117950:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572553.117958:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a958b1f0/0x977d9e7969c01b3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572553.118678:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.118686:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.118698:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.118702:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.118715:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.118728:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.118737:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.118745:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.119051:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572553.119057:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.119064:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.119068:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.119076:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.119088:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.119095:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.119102:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.119104:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.119166:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572553.119172:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca125bbc/0x977d9e7969c01b46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572553.119971:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.119978:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.119988:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.119992:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.119997:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.120007:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.120027:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.120035:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.120158:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572553.120163:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.120171:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.120174:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.120183:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.120195:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.120203:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.120205:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.120207:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.120371:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572553.120377:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d20df320/0x977d9e7969c01b4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572553.121796:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572553.121804:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.121816:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1788572553.121820:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572553.121825:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.121837:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.121847:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.121864:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.125632:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572553.125647:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.125661:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572553.125667:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.125679:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.125710:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.125719:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.125721:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.125723:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.125804:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572553.125812:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e1b6fe/0x977d9e7969c01b54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572553.126025:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788572553.126371:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572553.137377:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.137392:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.137409:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.137414:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.137420:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.137436:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.137447:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.139356:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.139388:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572553.139835:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572553.139843:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.139852:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572553.139863:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.139873:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.139895:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.139903:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969c01b5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.139923:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.139925:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.139927:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572553.140044:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.140051:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.140064:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.140068:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.140074:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.140085:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.140093:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.140102:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.140127:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572553.140157:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572553.140163:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.140170:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572553.140174:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.140182:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.140193:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.140207:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c01b62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.140220:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.140222:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.140234:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572553.142946:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.142959:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.142976:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.142981:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.142988:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.143016:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.143027:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.143036:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.143062:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572553.143286:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572553.143294:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.143302:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572553.143306:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.143316:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.143332:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.143340:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001da306fe/0x977d9e7969c01b69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.143359:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.143360:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.143362:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572553.148988:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.149000:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.149018:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.149023:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.149029:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.149045:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.149056:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.149079:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.149107:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.151566:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.151578:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.151591:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.151596:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.151608:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572553.152155:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.152163:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.152176:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.152181:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.152188:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.152200:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.152208:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.152216:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152540:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152550:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c01b70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152584:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.152588:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152594:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.152599:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152608:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152620:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.152628:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.152630:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.152632:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.153308:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.156746:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572553.156765:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf50f64/0x977d9e7969c01b77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572553.157642:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.157651:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.157666:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.157671:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.157676:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.157689:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.157699:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.157708:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.157726:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572553.158111:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.158117:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.158126:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.158129:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.158141:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.158152:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.158161:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.158167:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.160357:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572553.161001:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.161011:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.161027:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.161031:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.161037:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.161052:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.161061:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.161080:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163032:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572553.163047:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163059:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572553.163063:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163074:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163092:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163099:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2041739/0x977d9e7969c01b7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163119:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572553.163123:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163129:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572553.163132:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163139:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163160:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163167:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969c01b85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163180:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572553.163183:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163189:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572553.163193:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163201:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163210:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.163216:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.163218:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.163219:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.165667:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.165884:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572553.165896:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbfd8c62/0x977d9e7969c01b8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572553.166946:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.166955:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.166969:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.166974:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.166981:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.166996:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.167007:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.167015:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.168973:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.168987:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.168999:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.169004:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.169029:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.169051:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.169060:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.169062:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.169064:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.173542:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.174627:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572553.174641:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c01b93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572553.175781:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.175790:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.175806:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.175811:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.175818:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.175832:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.175842:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.175849:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.175877:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572553.176360:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.176368:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.176377:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.176382:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.176391:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.176408:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.176416:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969c01b9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.176444:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.176446:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.176447:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572553.176671:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572553.176678:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.176693:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1788572553.176697:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572553.176703:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.176714:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.176722:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.176730:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572553.176782:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788572553.176967:0:24340:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:67 00000100:00100000:1.0:1788572553.177062:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23680:x1875453518452224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 87322us (96904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.177073:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572553.177169:0:23680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23680:1875453518452224:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788572553.177183:0:23680:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x61:0x0] from OST, last_created [0x240000400:0x61:0x0]last_used is [0x240000400:0x43:0x0] 00000100:00100000:0.0:1788572553.177237:0:23680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23680:1875453518452352:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572553.177433:0:23680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.177533:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452352 00000100:00100000:1.0:1788572553.177540:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452352 00000100:00100000:1.0:1788572553.177578:0:24341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572553.177586:0:24341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23680:x1875453518452352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788572553.177623:0:24341:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 98 00000100:00100000:0.0:1788572553.179527:0:23680:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05218d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788572553.181567:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572553.181579:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.181593:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572553.181599:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.181610:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.181630:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.181638:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db68008e/0x977d9e7969c01ba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.181690:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.181692:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.181694:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572553.184142:0:24341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:23680:x1875453518452352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6550us (6703us total) trans 17179869185 rc 0/0 00000100:00100000:1.0:1788572553.184161:0:24341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572553.184514:0:23680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23680:1875453518452352:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788572553.184531:0:23680:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x61:0x0]-[0x240000400:0x81:0x0] 00010000:00010000:2.0:1788572553.261600:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572554.282535:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572554.516332:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869185 is committed 00000001:00100000:1.0:1788572554.516363:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788572555.318661:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572556.328562:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572557.352628:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572558.377014:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572558.440531:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572558.440538:0:22878:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788572558.440542:0:22878:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572558.440552:0:22878:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 773 00000100:00080000:2.0:1788572558.440557:0:22878:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572558.440564:0:22878:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf47469000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572558.440586:0:22878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04a554000 x1875453518452736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572558.440636:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518452864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.440729:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518452992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.440801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.440853:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572558.440858:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3220b4e-982e-4e01-8588-718942d18413:3299:1875453518452480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.440880:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.440901:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518452736:0@lo:8:kworker.0 00000100:00100000:3.0:1788572558.440917:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.440936:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452992 00000100:00100000:3.0:1788572558.440941:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452992 00000100:00100000:3.0:1788572558.440982:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572558.440989:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518452992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.441038:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518452992:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572558.441044:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572558.441126:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452480 00000100:00100000:3.0:1788572558.441129:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452480 00000100:00100000:3.0:1788572558.441148:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788572558.441152:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:3299:x1875453518452480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.441175:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:3299:x1875453518452480:12345-0@lo:400:kworker.0 Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572558.441178:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788572558.441197:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572558.441219:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3220b4e-982e-4e01-8588-718942d18413:3299:1875453518452480:0@lo:400:kworker.0 00010000:00080000:3.0:1788572558.441227:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04a557100 x1875453518452992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572558.441362:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518452608:0@lo:400:kworker.0 00000100:00100000:0.0:1788572558.441511:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572558.441545:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452736 00000100:00100000:0.0:1788572558.441548:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452736 00000100:00100000:0.0:1788572558.441559:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452608 00000100:00100000:0.0:1788572558.441561:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452608 00000100:00100000:0.0:1788572558.441576:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788572558.441580:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518452608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572558.441603:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518452608:12345-0@lo:400:kworker.0 Request processed in 23us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572558.441607:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788572558.441617:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572558.441620:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518452736:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572558.441632:0:24342:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572558.441708:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518452992:0@lo:400:kworker.0 00000100:00080000:3.0:1788572558.441928:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572558.442481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.443166:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518452864 00000100:00100000:3.0:1788572558.443172:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518452864 00000100:00100000:3.0:1788572558.443202:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572558.443207:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518452864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.444162:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518452864:12345-0@lo:400:kworker.0 Request processed in 40us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572558.444170:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572558.444224:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518453120:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788572558.444461:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04a557b80 x1875453518452864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572558.444473:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518452864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.444829:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572558.446556:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869185 gen 2 00000100:00100000:2.0:1788572558.446582:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518452608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572558.449342:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453120 00000100:00100000:1.0:1788572558.449357:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453120 00000100:00100000:1.0:1788572558.449568:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572558.449580:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518453120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572558.449619:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572558.449702:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518453120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572558.449710:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572558.449797:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518453120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572558.453965:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518452736:12345-0@lo:8:kworker.0 Request processed in 12335us (13039us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572558.453989:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788572558.454071:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572558.454077:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572558.454081:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518452736:0@lo:8:kworker.0 00010000:00010000:3.0:1788572559.401975:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572560.424596:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788572560.800716:0:25056:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788572560.800721:0:25056:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788572560.802914:0:25056:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88c04751b000 00000020:01000004:0.0:1788572560.802952:0:25056:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788572560.802967:0:25056:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788572560.802985:0:25056:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88bf47594d40) 00000020:00000080:0.0:1788572560.803002:0:25056:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788572560.860189:0:25056:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788572560.860494:0:25056:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788572560.866991:0:25056:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788572560.867440:0:25056:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788572560.867675:0:25056:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:0.0:1788572560.868176:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:0.0:1788572560.870146:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00100000:10000000:0.0:1788572560.870423:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:0.0:1788572560.874148:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 698: rc = 0 00100000:10000000:0.0:1788572560.874640:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 698: rc = 0 00100000:10000000:0.0:1788572560.877609:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 698: rc = 0 00100000:10000000:0.0:1788572560.877967:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 698: rc = 0 00100000:10000000:2.0:1788572560.885313:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 698: rc = 0 00100000:10000000:2.0:1788572560.885751:0:25056:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 698: rc = 0 00000020:00000080:2.0:1788572560.886420:0:25056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788572560.886434:0:25056:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788572560.886446:0:25056:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x977d9e7969c01baf 00000020:01000004:2.0:1788572560.886456:0:25056:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788572560.886478:0:25056:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788572560.886481:0:25056:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788572560.886487:0:25056:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788572560.886508:0:25056:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788572560.886520:0:25056:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788572560.920087:0:25056:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788572560.920135:0:25056:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788572560.920141:0:25056:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788572560.920142:0:25056:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572560.920144:0:25056:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572560.920145:0:25056:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572560.920146:0:25056:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572560.920147:0:25056:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572560.920149:0:25056:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572560.920152:0:25056:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572560.920153:0:25056:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572560.920157:0:25056:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788572560.920160:0:25056:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572560.920162:0:25056:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572560.920163:0:25056:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572560.920164:0:25056:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572560.920165:0:25056:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572560.920166:0:25056:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572560.920167:0:25056:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572560.920168:0:25056:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572560.920169:0:25056:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572560.920201:0:25056:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788572560.920223:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572560.920667:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572560.921000:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058227000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572560.923199:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453248 00000100:00100000:3.0:1788572560.923218:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453248 00000100:00100000:2.0:1788572560.929520:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788572560.929537:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:25056:x1875453518453248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572560.929578:0:23651:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788572560.929582:0:23651:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788572560.929586:0:23651:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788572560.937346:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:25056:x1875453518453248:12345-0@lo:253:mount.lustre.0 Request processed in 7804us (16670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572560.937363:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788572560.937525:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572560.937540:0:25056:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788572560.937543:0:25056:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572560.937545:0:25056:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788572560.937546:0:25056:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572560.937548:0:25056:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572560.937554:0:25056:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572560.937556:0:25056:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572560.937557:0:25056:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572560.937559:0:25056:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572560.937560:0:25056:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788572560.937602:0:25056:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88c04751b000 from lustre-OST0001 10000000:01000000:3.0:1788572560.937632:0:25056:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788572560.937635:0:25056:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788572560.937643:0:25056:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88c0760a4d40 local copy 00010000:00010000:3.0:1788572560.937653:0:25056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572560.938055:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572560.938100:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572560.938242:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c4143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572560.938447:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453376 00000100:00100000:0.0:1788572560.938455:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453376 00000100:00100000:0.0:1788572560.938530:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788572560.938539:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:25056:x1875453518453376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572560.938785:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+16:25056:x1875453518453376:12345-0@lo:501:mount.lustre.0 Request processed in 247us (684us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572560.938803:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788572560.938870:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788572560.938883:0:25056:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788572560.939037:0:25056:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788572560.939047:0:25056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.939058:0:25056:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c01947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0194e expref: -99 pid: 23639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572560.939085:0:25056:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88c04751b000 10000000:01000000:2.0:1788572560.939090:0:25056:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788572560.939096:0:25056:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788572560.939098:0:25056:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788572560.939102:0:25056:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788572560.939104:0:25056:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788572560.939131:0:25056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.939139:0:25056:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.939598:0:25056:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572560.939642:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572560.939679:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572560.939831:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572560.940030:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453504 00000100:00100000:3.0:1788572560.940037:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453504 00000100:00100000:3.0:1788572560.940071:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788572560.940081:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+16:25056:x1875453518453504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572560.940093:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572560.940106:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024b000/0x977d9e7969c01bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01bb6 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572560.940129:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024b000/0x977d9e7969c01bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01bb6 expref: 17 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572560.940138:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024b000/0x977d9e7969c01bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01bb6 expref: 17 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572560.940217:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b000, rc 0) 00000100:00100000:3.0:1788572560.940278:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453504:12345-0@lo:101:mount.lustre.0 Request processed in 199us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572560.940294:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572560.940376:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572560.940389:0:25056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01bbd expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.940403:0:25056:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01bbd expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572560.941460:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000040:00080000:0.0:1788572560.944515:0:25056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572560.944965:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788572560.945015:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:0.0:1788572560.945058:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:0.0:1788572560.945111:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:0.0:1788572560.945334:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:0.0:1788572560.945375:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:0.0:1788572560.945420:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:0.0:1788572560.945458:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:0.0:1788572560.945505:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 120 off9752 00000040:00080000:0.0:1788572560.945562:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9976 00000040:00080000:0.0:1788572560.945571:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 10 count 11 00000100:00100000:0.0:1788572560.945665:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572560.945726:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572560.945876:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572560.945999:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453632 00000100:00100000:3.0:1788572560.946008:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453632 00000100:00100000:3.0:1788572560.946096:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788572560.946107:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572560.946882:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453632:12345-0@lo:501:mount.lustre.0 Request processed in 776us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572560.946892:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572560.946976:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572560.947019:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572560.947064:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572560.947183:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572560.947320:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453760 00000100:00100000:0.0:1788572560.947326:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453760 00000100:00100000:0.0:1788572560.947356:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572560.947364:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572560.947670:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453760:12345-0@lo:503:mount.lustre.0 Request processed in 305us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.947677:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788572560.947876:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453760:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788572560.948723:0:25056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572560.949091:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572560.949146:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572560.949293:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572560.949432:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518453888 00000100:00100000:3.0:1788572560.949438:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518453888 00000100:00100000:3.0:1788572560.949479:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788572560.949488:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572560.949718:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518453888:12345-0@lo:502:mount.lustre.0 Request processed in 231us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572560.949725:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788572560.949892:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518453888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572560.950107:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788572560.950216:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:3.0:1788572560.950431:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:3.0:1788572560.950482:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:3.0:1788572560.950513:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:3.0:1788572560.950539:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:3.0:1788572560.950576:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:3.0:1788572560.950604:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:3.0:1788572560.950641:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 120 off9752 00000100:00100000:3.0:1788572560.950671:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572560.950718:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572560.950798:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c414000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572560.950869:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454016 00000100:00100000:1.0:1788572560.950875:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454016 00000100:00100000:1.0:1788572560.950953:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788572560.950961:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518454016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572560.951130:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518454016:12345-0@lo:502:mount.lustre.0 Request processed in 169us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.951138:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572560.951271:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572560.951350:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9976 00000040:00080000:0.0:1788572560.951368:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788572560.952518:0:25058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572560.952529:0:25058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788572560.952537:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.952538:0:25058:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788572560.952544:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572560.952559:0:25058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88c0760a19c0) 00000020:00000080:2.0:1788572560.952581:0:25058:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788572560.952586:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788572560.952647:0:25058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c04751b000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788572560.952656:0:25058:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788572560.952662:0:25058:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x977d9e7969c01bcb 00010000:00010000:0.0:1788572560.960516:0:25058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788572560.961479:0:25058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 12884901908 00080000:10000000:1.0:1788572560.964543:0:25058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:2.0:1788572560.966106:0:25058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788572560.966118:0:25058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572560.966124:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.966126:0:25058:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788572560.966137:0:25058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572560.966141:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.966142:0:25058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788572560.966145:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788572560.966160:0:25058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788572560.966163:0:25058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572560.966166:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.966167:0:25058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788572560.966169:0:25058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572560.966172:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.966173:0:25058:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788572560.966176:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788572560.966232:0:25058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572560.966235:0:25058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.966237:0:25058:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572560.966240:0:25058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 11 count 11 00000020:01000000:0.0:1788572560.966530:0:25056:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788572560.966553:0:25056:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788572560.966570:0:25056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01bbd expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.966582:0:25056:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0d800/0x977d9e7969c01bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01bbd expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572560.966590:0:25056:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c04751b000 from 1 10000000:01000000:0.0:1788572560.966593:0:25056:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572560.966627:0:25056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.966636:0:25056:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.966646:0:25056:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572560.966673:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572560.966735:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572560.966780:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572560.966870:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454144 00000100:00100000:2.0:1788572560.966877:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454144 00000100:00100000:2.0:1788572560.966934:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788572560.966943:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+17:25056:x1875453518454144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572560.966957:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572560.966969:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01bd2 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.966992:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.967003:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572560.967012:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ce00, rc 0) 00000100:00100000:2.0:1788572560.967050:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454144:12345-0@lo:101:mount.lustre.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572560.967065:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572560.967192:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572560.967207:0:25056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.967216:0:25056:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572560.967778:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:1.0:1788572560.971366:0:25056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572560.971744:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1788572560.971782:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:1.0:1788572560.971844:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:1.0:1788572560.971880:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:1.0:1788572560.971911:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:1.0:1788572560.972287:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:1.0:1788572560.972348:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9536 00000040:00080000:1.0:1788572560.972390:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 128 off9664 00000040:00080000:1.0:1788572560.973130:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:1.0:1788572560.973141:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:1.0:1788572560.973389:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572560.973536:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.973583:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572560.973828:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454272 00000100:00100000:0.0:1788572560.973840:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454272 00000100:00100000:0.0:1788572560.973897:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788572560.973908:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572560.974205:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454272:12345-0@lo:501:mount.lustre.0 Request processed in 298us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.974214:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572560.974314:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572560.974352:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572560.974394:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.982350:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572560.983345:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454400 00000100:00100000:0.0:1788572560.983361:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454400 00000100:00100000:0.0:1788572560.983458:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788572560.983470:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572560.983917:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454400:12345-0@lo:503:mount.lustre.0 Request processed in 449us (9523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.983934:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788572560.983977:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788572560.984619:0:25056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788572560.984693:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572560.984753:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572560.984808:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454528 00000100:00100000:2.0:1788572560.984811:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04136de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572560.984814:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454528 00000100:00100000:0.0:1788572560.984851:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572560.984860:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572560.986131:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454528:12345-0@lo:502:mount.lustre.0 Request processed in 1266us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.986143:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788572560.986337:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572560.986593:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:2.0:1788572560.986647:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:2.0:1788572560.986696:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:2.0:1788572560.986731:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:2.0:1788572560.986762:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000040:00080000:2.0:1788572560.987240:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:2.0:1788572560.987438:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9536 00000040:00080000:2.0:1788572560.987477:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 128 off9664 00000100:00100000:2.0:1788572560.987522:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572560.987599:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572560.987691:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04136de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572560.987730:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454656 00000100:00100000:1.0:1788572560.987738:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454656 00000100:00100000:1.0:1788572560.988029:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788572560.988040:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572560.988463:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454656:12345-0@lo:502:mount.lustre.0 Request processed in 423us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.988471:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788572560.988558:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572560.988678:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:2.0:1788572560.988689:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788572560.989704:0:25062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572560.989715:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.989718:0:25062:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788572560.989723:0:25062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c04751b000 00000020:00000080:2.0:1788572560.989726:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572560.989740:0:25062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572560.989742:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.989743:0:25062:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788572560.989746:0:25062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572560.989748:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.989749:0:25062:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788572560.989752:0:25062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c04751b000 00000020:00000080:2.0:1788572560.989754:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572560.989827:0:25062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572560.989831:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.989832:0:25062:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788572560.989835:0:25062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572560.989837:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.989839:0:25062:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788572560.989842:0:25062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88c04751b000 00000020:00000080:2.0:1788572560.989844:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572560.989879:0:25062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572560.989883:0:25062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572560.989884:0:25062:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788572560.989887:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000020:01000000:0.0:1788572560.997667:0:25056:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788572560.997712:0:25056:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572560.997733:0:25056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.997753:0:25056:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572560.997827:0:25056:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788572560.997830:0:25056:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88c04751b000 10000000:01000000:0.0:1788572560.997834:0:25056:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88c04751b000 10000000:01000000:0.0:1788572560.997838:0:25056:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572560.997843:0:25056:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c04751b000 from 1 10000000:01000000:0.0:1788572560.997846:0:25056:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572560.997885:0:25056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.997893:0:25056:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.997905:0:25056:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572560.997942:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572560.998015:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572560.998058:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454784 00000100:00100000:0.0:1788572560.998065:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454784 00000100:00100000:0.0:1788572560.998109:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788572560.998118:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518454784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572560.998132:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572560.998146:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90000/0x977d9e7969c01be7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01be0 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.998184:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90000/0x977d9e7969c01be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01be0 expref: 19 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.998194:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90000/0x977d9e7969c01be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01be0 expref: 19 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.998203:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90000, rc 0) 00000100:00100000:0.0:1788572560.998237:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518454784:12345-0@lo:101:mount.lustre.0 Request processed in 120us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.998244:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788572560.998315:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0507f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572560.998342:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572560.998357:0:25056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01be7 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572560.998365:0:25056:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01be7 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572560.998991:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:0.0:1788572560.999719:0:25056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572561.011215:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788572561.011312:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:0.0:1788572561.011680:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:0.0:1788572561.011737:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:0.0:1788572561.011928:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:0.0:1788572561.013149:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:0.0:1788572561.013345:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:0.0:1788572561.013383:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:0.0:1788572561.014181:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788572561.014319:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:0.0:1788572561.014354:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:0.0:1788572561.014738:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:0.0:1788572561.014868:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:0.0:1788572561.014905:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:0.0:1788572561.015496:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:0.0:1788572561.015539:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:0.0:1788572561.015570:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:0.0:1788572561.016097:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:0.0:1788572561.016139:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:0.0:1788572561.016175:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:0.0:1788572561.016239:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:0.0:1788572561.016350:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:0.0:1788572561.016387:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:0.0:1788572561.016452:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:0.0:1788572561.016491:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:0.0:1788572561.016527:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:0.0:1788572561.016574:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:0.0:1788572561.016625:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:0.0:1788572561.016661:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:0.0:1788572561.016710:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:0.0:1788572561.016749:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:0.0:1788572561.016782:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:0.0:1788572561.016842:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:0.0:1788572561.016893:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:0.0:1788572561.016938:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:0.0:1788572561.037692:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:0.0:1788572561.037779:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:0.0:1788572561.037814:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:0.0:1788572561.037865:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:0.0:1788572561.037904:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:1.0:1788572561.052633:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:1.0:1788572561.052653:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:1.0:1788572561.052777:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572561.052846:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572561.052888:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518454912 00000100:00100000:1.0:1788572561.052899:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518454912 00000100:00100000:1.0:1788572561.052970:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572561.052982:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518454912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572561.053216:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518454912:12345-0@lo:501:mount.lustre.0 Request processed in 237us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572561.053229:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572561.053291:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572561.053315:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518454912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572561.053348:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518455040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572561.053385:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572561.053399:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572561.057179:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455040 00000100:00100000:0.0:1788572561.058311:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455040 00000100:00100000:0.0:1788572561.058370:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572561.058382:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518455040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572561.059110:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518455040:12345-0@lo:503:mount.lustre.0 Request processed in 727us (5720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572561.059120:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572561.060709:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518455040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572561.065668:0:25056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572561.065762:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518455168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572561.065853:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572561.065903:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0411c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572561.067140:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455168 00000100:00100000:1.0:1788572561.067157:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455168 00000100:00100000:1.0:1788572561.067296:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788572561.067308:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518455168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572561.067647:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518455168:12345-0@lo:502:mount.lustre.0 Request processed in 341us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572561.067655:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572561.067771:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518455168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572561.068106:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788572561.068157:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:0.0:1788572561.070092:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:0.0:1788572561.071321:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:0.0:1788572561.071386:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:0.0:1788572561.071429:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:0.0:1788572561.071815:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:0.0:1788572561.071846:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:0.0:1788572561.071890:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788572561.071930:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:0.0:1788572561.073303:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:0.0:1788572561.073363:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:0.0:1788572561.073393:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:0.0:1788572561.073420:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:0.0:1788572561.073629:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:0.0:1788572561.073661:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:0.0:1788572561.073698:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:0.0:1788572561.073739:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:0.0:1788572561.073767:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:0.0:1788572561.073814:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:0.0:1788572561.073857:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:0.0:1788572561.073887:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:0.0:1788572561.073914:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:0.0:1788572561.075154:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:0.0:1788572561.075356:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:0.0:1788572561.075393:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:0.0:1788572561.075649:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:0.0:1788572561.075691:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:0.0:1788572561.075729:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:0.0:1788572561.075782:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:0.0:1788572561.075818:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:0.0:1788572561.075851:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:0.0:1788572561.075886:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:0.0:1788572561.075944:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:0.0:1788572561.076865:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:0.0:1788572561.077100:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:0.0:1788572561.077143:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:0.0:1788572561.077176:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:0.0:1788572561.077694:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:0.0:1788572561.077729:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:0.0:1788572561.077783:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518455296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572561.077867:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572561.077928:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455296 00000100:00100000:0.0:1788572561.077936:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455296 00000100:00100000:0.0:1788572561.079105:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788572561.079122:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518455296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572561.079529:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518455296:12345-0@lo:502:mount.lustre.0 Request processed in 411us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572561.079545:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788572561.079618:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0411c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572561.079656:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518455296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572561.079762:0:25056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:0.0:1788572561.079778:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788572561.082893:0:25067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788572561.082911:0:25067:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88bf46070000) 00000020:00000080:3.0:1788572561.082950:0:25067:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788572561.083153:0:25067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c04751b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788572561.083158:0:25067:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c04751b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788572561.083160:0:25067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c04751b000 3 00010000:00080000:3.0:1788572561.083428:0:25067:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c058f76000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788572561.088539:0:25067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788572561.088740:0:25067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788572561.088777:0:25067:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572561.088788:0:25067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x977d9e7969c01bf5 00000100:00080000:3.0:1788572561.088800:0:25067:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572561.088806:0:25067:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88c058f76000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572561.088844:0:25067:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c049acb800 x1875453518455424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572561.088869:0:25067:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788572561.088981:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518455424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572561.089051:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572561.093453:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788572561.093477:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572561.093482:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788572561.093486:0:36:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572561.093494:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 779 00000100:00080000:3.0:1788572561.093498:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572561.093505:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf47469000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572561.093522:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455424 00000100:00100000:3.0:1788572561.093531:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455424 00000100:00100000:3.0:1788572561.093581:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572561.093589:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518455424:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572561.093617:0:23658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 781 last 0 00000020:00000080:3.0:1788572561.093659:0:23658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x977d9e7969c01bfc 00000004:00100000:3.0:1788572561.093674:0:23658:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572561.093722:0:23658:0:(import.c:65:import_set_state_nolock()) ffff88c07f74a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572561.093808:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875453518455424:12345-0@lo:38:llog_process_th.0 Request processed in 218us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572561.093816:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788572561.093870:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c049acb800 x1875453518455424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572561.093881:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572561.093889:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 4 00000100:00080000:3.0:1788572561.093895:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788572561.093899:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788572561.093901:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c058f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788572561.093906:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518455424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572561.093969:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c049acb800 x1875453518455680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572561.094331:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518455808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572561.094372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572561.094400:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518455552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572561.094423:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572561.094803:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455808 00000100:00100000:3.0:1788572561.094810:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455808 00000100:00100000:3.0:1788572561.094888:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572561.094898:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572561.094955:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518455808:12345-0@lo:400:kworker.0 Request processed in 61us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572561.094973:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788572561.095943:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455552 00000100:00100000:1.0:1788572561.095952:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455552 00000100:00100000:1.0:1788572561.096008:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572561.096017:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572561.096074:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518455552:12345-0@lo:400:kworker.0 Request processed in 59us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572561.096081:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788572561.096129:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788572561.099560:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c049acbb80 x1875453518455808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572561.099588:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518455808:0@lo:400:kworker.0 00000100:00100000:3.0:1788572561.099651:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518455552:0@lo:400:kworker.0 00000100:00100000:3.0:1788572561.099807:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518455680:0@lo:8:kworker.0 00000100:00100000:3.0:1788572561.099882:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572561.099945:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455680 00000100:00100000:3.0:1788572561.099951:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455680 00000100:00100000:3.0:1788572561.100302:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572561.100311:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518455680:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788572561.100376:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518455680:12345-0@lo:8:kworker.0 Request processed in 64us (494us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572561.100384:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572561.100431:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572561.100438:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572561.100443:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572561.100446:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518455680:0@lo:8:kworker.0 00000100:00100000:3.0:1788572561.100502:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518455936:0@lo:400:kworker.0 00000100:00100000:3.0:1788572561.100532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572561.100564:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518455936 00000100:00100000:3.0:1788572561.100568:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518455936 00000100:00100000:3.0:1788572561.100610:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788572561.100623:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518455936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572561.100662:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518455936:12345-0@lo:400:kworker.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572561.100668:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788572561.100684:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788572561.100707:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c049acb800 x1875453518455936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572561.100717:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518455936:0@lo:400:kworker.0 00000040:00080000:3.0:1788572561.105531:0:25067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000020:01000000:0.0:1788572561.105727:0:25056:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788572561.105760:0:25056:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572561.105778:0:25056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01be7 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.105790:0:25056:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b91000/0x977d9e7969c01be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01be7 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788572561.105849:0:25056:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788572561.105851:0:25056:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788572561.105853:0:25056:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572561.105854:0:25056:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572561.105855:0:25056:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572561.105856:0:25056:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572561.105858:0:25056:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572561.105860:0:25056:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572561.105861:0:25056:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572561.105865:0:25056:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788572561.105868:0:25056:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572561.105875:0:25056:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788572561.105876:0:25056:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572561.105877:0:25056:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572561.105878:0:25056:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572561.105879:0:25056:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572561.105880:0:25056:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572561.105881:0:25056:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572561.105882:0:25056:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572561.105910:0:25056:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788572561.105942:0:25056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518456064:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572561.106164:0:25056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572561.106360:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456064 00000100:00100000:3.0:1788572561.106368:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456064 00000100:00100000:3.0:1788572561.106421:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788572561.106431:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:25056:x1875453518456064:12345-0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572561.106527:0:25056:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0411c8480 going to sleep for 11 seconds 20000000:01000000:3.0:1788572561.106602:0:23649:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788572561.106616:0:23649:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788572561.157993:0:23649:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788572561.158015:0:23649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788572561.158676:0:23673:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572561.158682:0:23673:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572561.158705:0:23673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572561.158726:0:23673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 19 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572561.158735:0:23673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572561.158778:0:23673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 19 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572561.158811:0:23673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 19 pid: 23649 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572561.158828:0:23673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23673:1875453518456192:0@lo:104: 00000100:00100000:2.0:1788572561.158906:0:23673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572561.158973:0:23673:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572561.159145:0:23640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456192 00000100:00100000:0.0:1788572561.159153:0:23640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456192 00000100:00100000:0.0:1788572561.159339:0:23640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572561.159353:0:23640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a556300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:23673:x1875453518456192:12345-0@lo:104: 00010000:00010000:0.0:1788572561.159368:0:23640:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159424:0:23640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572561.159430:0:23640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a556300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3220b4e-982e-4e01-8588-718942d18413+3:23673:x1875453518456192:12345-0@lo:104: Request processed in 81us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572561.159621:0:23640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572561.159673:0:23673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23673:1875453518456192:0@lo:104: 00010000:00010000:0.0:1788572561.159695:0:23673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159713:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572561.159720:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159744:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572561.159750:0:23645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159758:0:23645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572561.159765:0:23645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572561.159770:0:23645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572561.159801:0:23645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159808:0:23645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572561.159830:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159838:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387000/0x977d9e7969c01ac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01ac8 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.159858:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572561.159860:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572561.159862:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572561.159885:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518456320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572561.159931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572561.160058:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456320 00000100:00100000:0.0:1788572561.160064:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456320 00010000:00010000:0.0:1788572561.160083:0:23642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 20 pid: 23649 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572561.160116:0:23642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572561.160124:0:23642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3220b4e-982e-4e01-8588-718942d18413+20:3300:x1875453518456320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572561.161642:0:23642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572561.161664:0:23642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 20 pid: 23649 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161684:0:23642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 20 pid: 23649 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161703:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01ac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c01ac1 expref: 20 pid: 23649 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161723:0:23642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161731:0:23642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572561.161751:0:23642:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008427991s 00010000:00010000:0.0:1788572561.161756:0:23642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161763:0:23642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161771:0:23642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161777:0:23642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161797:0:23642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572561.161802:0:23642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161810:0:23642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161826:0:23642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.161837:0:23642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572561.161925:0:23642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3220b4e-982e-4e01-8588-718942d18413+19:3300:x1875453518456320:12345-0@lo:103:ldlm_bl.0 Request processed in 1790us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572561.161936:0:23642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788572561.162306:0:23673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.162315:0:23673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572561.162322:0:23673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0c800/0x977d9e7969c01c03 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572561.162364:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518456320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572561.176336:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+18:25056:x1875453518456064:12345-0@lo:253:mount.lustre.0 Request processed in 69897us (70162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572561.176351:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788572561.176462:0:25056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3220b4e-982e-4e01-8588-718942d18413:25056:1875453518456064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788572561.176476:0:25056:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788572561.176480:0:25056:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788572561.176482:0:25056:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572561.176483:0:25056:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572561.176484:0:25056:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572561.176486:0:25056:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572561.176487:0:25056:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572561.176488:0:25056:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572561.176490:0:25056:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572561.176491:0:25056:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788572561.176505:0:25056:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788572561.177444:0:25056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788572561.177630:0:25056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788572561.177901:0:25056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788572561.178341:0:25056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788572561.178608:0:25056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788572561.178769:0:25056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788572561.188926:0:25056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869184 00002000:00080000:1.0:1788572561.236227:0:25056:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788572561.236238:0:25056:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788572561.236298:0:25056:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788572561.236375:0:25056:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788572561.236400:0:25056:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788572561.236429:0:25056:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788572561.448570:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572561.832826:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788572562.472962:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788572562.927835:0:23653:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572562.927852:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf47978000 from 14 10000000:01000000:2.0:1788572562.927859:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572562.927911:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.927944:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.927957:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572562.927988:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518456448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572562.928071:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572562.928120:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050694540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572562.928144:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456448 00000100:00100000:2.0:1788572562.928151:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456448 00000100:00100000:2.0:1788572562.928199:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788572562.928208:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518456448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572562.928222:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572562.928236:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0d000/0x977d9e7969c01c11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01c0a expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.928278:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0d000/0x977d9e7969c01c11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01c0a expref: 19 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.928289:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0d000/0x977d9e7969c01c11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01c0a expref: 19 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.928299:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d000, rc 0) 00000100:00100000:2.0:1788572562.928336:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518456448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572562.928342:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788572562.928394:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518456448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572562.928407:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01c11 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.928415:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01c11 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572562.928553:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518456576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572562.928700:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572562.928716:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050694540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572562.928731:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456576 00000100:00100000:2.0:1788572562.928735:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456576 00000100:00100000:2.0:1788572562.928757:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788572562.928763:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518456576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572562.928777:0:23649:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572562.928794:0:23649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572562.928797:0:23649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788572562.928881:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518456576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572562.928889:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788572562.928920:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518456576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788572562.928975:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572562.928983:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01c11 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572562.928991:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c01c0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01c11 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572563.497494:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572563.569581:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518456704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572563.569656:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572563.569749:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456704 00000100:00100000:2.0:1788572563.569758:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456704 00000100:00100000:2.0:1788572563.569829:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572563.569840:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518456704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572563.569892:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788572563.575926:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572563.582640:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518456704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12787us (12968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572563.582656:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788572563.583283:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518456704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572564.520661:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572565.547079:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572566.121591:0:22878:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572566.121599:0:22878:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788572566.121603:0:22878:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572566.121617:0:22878:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf47469000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572566.121641:0:22878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c049aca300 x1875453518457088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572566.121701:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518457088:0@lo:8:kworker.0 00000100:00100000:3.0:1788572566.121780:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572566.121866:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457088 00000100:00100000:3.0:1788572566.121874:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457088 00000100:00100000:3.0:1788572566.121910:0:24341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572566.121918:0:24341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3296:x1875453518457088:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788572566.121948:0:24341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 786 last 0 00000100:00100000:0.0:1788572566.122051:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518456832:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.122130:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518457472:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122160:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.122182:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572566.122187:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518457344:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.122232:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518456960:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.122304:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572566.122310:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518457216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122331:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.122359:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456832 00000100:00100000:0.0:1788572566.122364:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456832 00000100:00100000:0.0:1788572566.122397:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572566.122403:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:3298:x1875453518456832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122444:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:3298:x1875453518456832:12345-0@lo:400:kworker.0 Request processed in 41us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572566.122451:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572566.122483:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457472 00000100:00100000:0.0:1788572566.122487:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457472 00000100:00100000:0.0:1788572566.122519:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457344 00000100:00100000:0.0:1788572566.122522:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457344 00000100:00100000:0.0:1788572566.122534:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457216 00000100:00100000:0.0:1788572566.122537:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457216 00000100:00100000:0.0:1788572566.122561:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572566.122567:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518457472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122598:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518457472:12345-0@lo:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572566.122604:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572566.122617:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788572566.122622:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518457344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122648:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518457344:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572566.122653:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788572566.122665:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572566.122671:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518457216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122700:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518457216:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572566.122705:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572566.122736:0:24340:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788572566.122745:0:24340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1788572566.122786:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c049ac8380 x1875453518457344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572566.122800:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518457344:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.122811:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518456832:0@lo:400:kworker.0 00010000:00080000:0.0:1788572566.122820:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c049acad80 x1875453518457472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572566.122829:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518457472:0@lo:400:kworker.0 00010000:00080000:0.0:1788572566.122873:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c049ac8a80 x1875453518457216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572566.122881:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518457216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.123000:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518456960 00000100:00100000:0.0:1788572566.123004:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518456960 00000100:00100000:0.0:1788572566.123026:0:24340:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788572566.123034:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572566.123040:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518456960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572566.123076:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518456960:12345-0@lo:400:kworker.0 Request processed in 36us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572566.123082:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572566.123106:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518456960:0@lo:400:kworker.0 00000020:00000080:3.0:1788572566.123481:0:24341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c01c18 00002000:00100000:3.0:1788572566.123496:0:24341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88c07f74f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788572566.123501:0:24341:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788572566.123510:0:24341:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788572566.123935:0:24341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788572566.123963:0:24341:0:(import.c:65:import_set_state_nolock()) ffff88c07f748800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788572566.124376:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572566.124381:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572566.125313:0:24341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1875453518457088:12345-0@lo:8:kworker.0 Request processed in 3391us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572566.125323:0:24341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788572566.125602:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c049aca300 x1875453518457088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572566.125619:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1788572566.125626:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572566.125631:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788572566.125634:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf47469000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788572566.125653:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788572566.125658:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518457088:0@lo:8:kworker.0 00000100:00100000:2.0:1788572566.125829:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518457600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572566.125873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572566.125928:0:23682:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x43:0x0] 00000100:00100000:0.0:1788572566.125951:0:23682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23682:1875453518457728:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788572566.125991:0:23682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.126009:0:23682:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788572566.126025:0:23681:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572566.126514:0:23681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786917264256ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788572566.126542:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457728 00000100:00100000:0.0:1788572566.126549:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457728 00000100:00100000:0.0:1788572566.126601:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572566.126609:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23682:x1875453518457728:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572566.127792:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457600 00000100:00100000:3.0:1788572566.127800:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457600 00000100:00100000:3.0:1788572566.127845:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572566.127853:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518457600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572566.127878:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00002000:00080000:0.0:1788572566.132925:0:24340:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788572566.132937:0:24340:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -30 00002000:02000040:0.0:1788572566.132942:0:24340:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:68 to 0x280000400:97) 00000100:00100000:3.0:1788572566.143126:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518457600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15254us (17233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572566.143142:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788572566.143213:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788572566.150103:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f4000 x1875453518457600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572566.150143:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518457600:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788572566.159088:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.159114:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159143:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.159149:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.159154:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159171:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159181:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159189:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159207:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572566.159752:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.159759:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159769:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.159772:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.159776:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159784:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159799:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159805:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.159822:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572566.160237:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.160243:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160280:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.160284:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.160290:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160298:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160306:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160312:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160330:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788572566.160728:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.160734:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160743:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.160746:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.160750:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160759:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160768:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160775:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.160783:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788572566.161157:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.161162:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161171:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.161180:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.161184:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161194:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161202:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161209:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161217:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788572566.161653:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.161660:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161668:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.161671:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.161675:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161684:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161691:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161703:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.161711:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788572566.164041:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572566.164052:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164063:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.164068:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164086:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164106:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164113:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0c4b79/0x977d9e7969c01c1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164145:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572566.164149:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164155:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.164157:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164164:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164173:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164179:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4bdfbb5/0x977d9e7969c01c26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164201:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572566.164204:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164210:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.164213:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164220:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164228:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164236:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005648049f/0x977d9e7969c01c2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164283:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572566.164288:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164293:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.164296:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164314:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164323:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164330:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000514bae58/0x977d9e7969c01c34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164343:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572566.164346:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164352:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.164356:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164363:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164372:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164379:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000419cc87f/0x977d9e7969c01c3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164402:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572566.164406:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164412:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.164415:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164421:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164430:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164437:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01c42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.164449:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.164450:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.164452:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.166826:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.173631:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.173642:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.173659:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.173663:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.173670:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.173686:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.173697:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.173706:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.173735:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572566.174120:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.174127:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174141:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.174145:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.174149:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174159:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174168:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174175:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174189:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572566.174607:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.174614:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174623:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.174626:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.174630:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174640:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174659:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174665:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.174672:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788572566.175075:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.175081:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175089:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.175092:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.175096:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175105:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175112:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175120:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175139:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788572566.175532:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.175538:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175546:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.175549:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.175553:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175562:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175570:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175598:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.175688:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788572566.176852:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572566.176864:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176876:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.176889:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176900:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176918:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176927:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01c49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176948:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572566.176952:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176958:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.176961:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176968:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176977:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.176985:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01c50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177003:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572566.177007:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177014:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.177017:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177025:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177035:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177042:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01c57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177053:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572566.177057:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177063:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.177066:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177086:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177097:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177104:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01c5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177117:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572566.177121:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177127:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.177130:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177138:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177148:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177155:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01c65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.177180:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.177182:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.177184:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.177190:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.195310:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.195328:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.195349:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.195363:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.195372:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.195389:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.195401:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.195409:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.195432:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572566.197633:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572566.197648:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.197661:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572566.197666:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.197677:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.197699:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.197706:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000216b9c06/0x977d9e7969c01c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572566.197742:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.197747:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.197748:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.199572:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.199586:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.199603:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.199609:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.199617:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.199633:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.199643:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.199658:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.199682:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572566.200387:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.200395:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200405:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.200408:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.200413:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200423:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200431:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200437:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200459:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572566.200473:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572566.200480:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200495:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.200499:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200509:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200526:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200533:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2a483bf/0x977d9e7969c01c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200554:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.200557:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200563:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.200566:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200572:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200581:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200594:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007330ad6b/0x977d9e7969c01c7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.200608:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.200609:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.200611:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.201033:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.201040:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201048:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.201052:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.201056:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201065:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201074:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201081:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201095:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.201104:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.201113:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201120:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.201124:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201132:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201143:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201150:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfe94dd8/0x977d9e7969c01c81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.201162:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.201164:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.201165:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572566.205744:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.212531:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.212545:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212562:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.212567:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.212574:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212602:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212613:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212622:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212643:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.212662:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.212669:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212677:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.212681:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212691:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212707:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212725:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1190218/0x977d9e7969c01c88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.212754:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.212756:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.212757:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.213169:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.213176:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213186:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.213189:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.213194:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213203:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213212:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213219:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213237:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.213246:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.213274:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213294:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.213297:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213303:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213313:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213320:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000512e32d8/0x977d9e7969c01c8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213333:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.213335:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.213337:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.213743:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.213749:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213757:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.213760:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.213764:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213773:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213788:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213795:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213808:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.213817:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.213820:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213827:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.213830:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213839:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213849:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213856:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0c18450/0x977d9e7969c01c96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.213871:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.213878:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.213880:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.214288:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.214294:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214303:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788572566.214306:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.214310:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214320:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214327:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214334:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214348:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.214356:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.214360:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214367:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.214370:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214390:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214401:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214410:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f1b504/0x977d9e7969c01c9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.214425:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.214427:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.214428:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.223188:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.223203:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223221:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.223226:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.223233:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223268:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223294:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223309:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223327:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.223340:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.223346:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223355:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.223359:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223368:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223383:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223392:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000081b987b/0x977d9e7969c01ca4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223413:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.223415:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.223417:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.223899:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.223913:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223923:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.223927:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.223931:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223940:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223947:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223954:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223968:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.223977:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.223981:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223987:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.223990:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.223996:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224015:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224021:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d87adb7d/0x977d9e7969c01cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224037:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.224038:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.224040:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.224454:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.224461:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224470:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.224473:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.224477:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224485:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224494:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224501:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224527:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.224536:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.224540:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224547:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.224550:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224558:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224569:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224576:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073de337f/0x977d9e7969c01cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.224589:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.224591:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.224592:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.224986:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.224992:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225000:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.225009:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.225013:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225022:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225030:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225037:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225050:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.225059:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.225063:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225070:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.225073:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225081:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225091:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225108:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc77c16/0x977d9e7969c01cb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225123:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.225125:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.225127:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.225535:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.225542:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225551:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.225554:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.225558:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225567:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225575:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225581:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225594:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.225601:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.225610:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225618:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.225621:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225629:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225640:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225648:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000821b3268/0x977d9e7969c01cc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.225662:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.225664:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.225666:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.233312:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.233323:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233340:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.233345:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.233352:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233380:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233391:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233399:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233417:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.233430:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.233436:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233443:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.233448:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233457:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233473:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233480:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080559b49/0x977d9e7969c01cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233506:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.233507:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.233509:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.233896:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.233902:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233909:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.233912:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.233915:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233924:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233930:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233936:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233949:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.233958:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.233962:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233980:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d55e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.233983:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.233991:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234001:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234009:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054517865/0x977d9e7969c01cce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234022:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.234023:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.234025:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.234421:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.234427:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234435:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.234437:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.234441:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234449:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234462:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234469:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234480:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.234488:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.234491:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234497:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf45d54000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.234500:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234506:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234517:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234524:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000158d742c/0x977d9e7969c01cd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234537:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.234544:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.234545:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.234936:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.234942:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234950:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.234953:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.234957:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234966:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234973:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234980:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.234993:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.235001:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.235004:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235010:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a5800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.235013:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235030:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235041:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235047:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d0663bb/0x977d9e7969c01cdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235060:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.235062:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.235063:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.235453:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.235459:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235468:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.235471:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.235475:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235484:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235492:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235504:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235516:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572566.235526:0:23645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572566.235529:0:23645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235535:0:23645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a4400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572566.235538:0:23645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235545:0:23645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235555:0:23645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235562:0:23645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004272efec/0x977d9e7969c01ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.235574:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.235576:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572566.235577:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572566.246066:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572566.246085:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.246101:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1788572566.246107:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572566.246127:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.246143:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.246154:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.246163:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572566.246183:0:24340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788572566.248969:0:24340:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:67 00000100:00100000:0.0:1788572566.249076:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23682:x1875453518457728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 122463us (123079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572566.249087:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788572566.249495:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572566.249507:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572566.249520:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a4200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572566.249525:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572566.249550:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572566.249572:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572566.249580:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c4fcaf0/0x977d9e7969c01cea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572566.249602:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572566.249604:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572566.249607:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572566.249703:0:23682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23682:1875453518457728:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788572566.249728:0:23682:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x61:0x0] from OST, last_created [0x280000400:0x61:0x0]last_used is [0x280000400:0x43:0x0] 00000100:00100000:0.0:1788572566.249775:0:23682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23682:1875453518457856:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788572566.249812:0:23682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572566.249869:0:23682:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572566.249886:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457856 00000100:00100000:0.0:1788572566.249893:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457856 00000100:00100000:0.0:1788572566.249931:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572566.249951:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23682:x1875453518457856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788572566.250090:0:24340:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 98 00000100:00100000:0.0:1788572566.255626:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:23682:x1875453518457856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5680us (5806us total) trans 17179869185 rc 0/0 00000100:00100000:0.0:1788572566.255640:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572566.255867:0:23682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23682:1875453518457856:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788572566.255884:0:23682:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x61:0x0]-[0x280000400:0x81:0x0] 00000004:00080000:0.0:1788572566.291993:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788572566.577860:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788572566.739864:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869185 is committed 00000001:00100000:3.0:1788572566.740679:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788572567.597198:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572568.618221:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572568.681857:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572568.681881:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518457984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572568.681987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572568.682055:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518457984 00000100:00100000:1.0:1788572568.682062:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518457984 00000100:00100000:1.0:1788572568.682137:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572568.682146:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518457984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572568.682184:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572568.682230:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518457984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572568.682237:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788572568.682284:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572568.682395:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518457984:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788572569.249103:0:25415:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788572569.647316:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572570.664729:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572571.048978:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788572571.241456:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518458240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241543:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572571.241590:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518458752:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241613:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572571.241637:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788572571.241642:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518458112:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572571.241690:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518458624:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572571.241731:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518458368:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572571.241765:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572571.241769:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518458496:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572571.241813:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458752 00000100:00100000:0.0:1788572571.241820:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458752 00000100:00100000:0.0:1788572571.241864:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458624 00000100:00100000:0.0:1788572571.241879:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458624 00000100:00100000:0.0:1788572571.241893:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458496 00000100:00100000:0.0:1788572571.241895:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458496 00000100:00100000:0.0:1788572571.241908:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572571.241916:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518458752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.241962:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518458752:12345-0@lo:400:kworker.0 Request processed in 47us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.241969:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572571.241987:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572571.241992:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518458624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.242012:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518458624:12345-0@lo:400:kworker.0 Request processed in 21us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.242017:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572571.242026:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788572571.242031:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518458496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.242055:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518458496:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.242061:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788572571.242080:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788572571.242106:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c557100 x1875453518458496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572571.242120:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518458496:0@lo:400:kworker.0 00010000:00080000:0.0:1788572571.242142:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c554a80 x1875453518458624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572571.242149:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518458624:0@lo:400:kworker.0 00010000:00080000:0.0:1788572571.242169:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c554380 x1875453518458752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572571.242176:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518458752:0@lo:400:kworker.0 00000100:00100000:3.0:1788572571.242676:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458240 00000100:00100000:3.0:1788572571.242683:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458240 00000100:00100000:3.0:1788572571.242722:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458368 00000100:00100000:3.0:1788572571.242725:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458368 00000100:00100000:3.0:1788572571.242743:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572571.242749:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518458240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572571.242794:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518458240:12345-0@lo:400:kworker.0 Request processed in 46us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572571.242807:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572571.242820:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572571.242825:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518458368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572571.242858:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518458368:12345-0@lo:400:kworker.0 Request processed in 33us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572571.242863:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572571.242880:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458112 00000100:00100000:3.0:1788572571.242884:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458112 00000100:00100000:3.0:1788572571.242905:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572571.242910:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:3298:x1875453518458112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572571.242938:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:3298:x1875453518458112:12345-0@lo:400:kworker.0 Request processed in 27us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572571.242944:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788572571.242975:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572571.242978:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572571.242999:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869185 gen 2 00000100:00100000:3.0:1788572571.243012:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518458368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572571.243034:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518458112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572571.243044:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518458240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572571.249472:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518458880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572571.249755:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572571.253036:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518458880 00000100:00100000:1.0:1788572571.253055:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518458880 00000100:00100000:3.0:1788572571.255784:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572571.255799:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518458880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572571.255843:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788572571.255922:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518458880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (6167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572571.255950:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572571.259755:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518458880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572571.689604:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572571.926913:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572571.926947:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495408512 00000100:00100000:0.0:1788572571.926957:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495408512 00000100:00100000:0.0:1788572571.926992:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788572571.927000:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875453495408512:12345-192.168.202.2@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788572571.927027:0:23650:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2f28dd17-6644-45dd-bf11-f8af88abec3c@192.168.202.2@tcp t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:0.0:1788572571.927054:0:23650:0:(genops.c:1385:class_connect()) connect: client 2f28dd17-6644-45dd-bf11-f8af88abec3c, cookie 0x977d9e7969c01cf1 00000100:00080000:0.0:1788572571.927171:0:23650:0:(import.c:65:import_set_state_nolock()) ffff88c065ad3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572571.927226:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+5:2352:x1875453495408512:12345-192.168.202.2@tcp:250:mount.lustre.0 Request processed in 225us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.927233:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1788572571.967465:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572571.967902:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495408640 00000100:00100000:0.0:1788572571.967914:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495408640 00000100:00100000:0.0:1788572571.968035:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1788572571.968048:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+5:20549:x1875453495408640:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572571.968070:0:23649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572571.968095:0:23649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bf410a5a00/0x977d9e7969c01cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb116be expref: -99 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572571.968168:0:23649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bf410a5a00/0x977d9e7969c01cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116be expref: 6 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572571.968180:0:23649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bf410a5a00/0x977d9e7969c01cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116be expref: 6 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572571.968189:0:23649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a5a00, rc 0) 00000100:00100000:0.0:1788572571.968307:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+6:20549:x1875453495408640:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 262us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.968314:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1788572571.978618:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572571.978748:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495408768 00000100:00100000:3.0:1788572571.978760:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495408768 00000100:00100000:3.0:1788572571.978821:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788572571.978833:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+6:20549:x1875453495408768:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788572571.979114:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+6:20549:x1875453495408768:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 283us (507us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572571.979123:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788572571.985469:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572571.985599:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495408896 00000100:00100000:0.0:1788572571.985611:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495408896 00000100:00100000:0.0:1788572571.985681:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1788572571.985692:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+6:20549:x1875453495408896:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572571.985711:0:23649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572571.985745:0:23649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bf410a5400/0x977d9e7969c01cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb116c5 expref: -99 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572571.985789:0:23649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bf410a5400/0x977d9e7969c01cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116c5 expref: 7 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572571.985803:0:23649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bf410a5400/0x977d9e7969c01cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116c5 expref: 7 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572571.985815:0:23649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a5400, rc 0) 00000100:00100000:0.0:1788572571.985896:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+7:20549:x1875453495408896:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 205us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.985923:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1788572571.990459:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572571.990698:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409024 00000100:00100000:0.0:1788572571.990709:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409024 00000100:00100000:0.0:1788572571.990783:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:0.0:1788572571.990794:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+7:20549:x1875453495409024:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788572571.991096:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20549:x1875453495409024:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 303us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572571.991104:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:1.0:1788572571.997969:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572571.998052:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409152 00000100:00100000:3.0:1788572571.998062:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409152 00000100:00100000:3.0:1788572571.998124:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1788572571.998135:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20549:x1875453495409152:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788572571.998383:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20549:x1875453495409152:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 248us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572571.998390:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:1.0:1788572572.002686:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572572.002777:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409280 00000100:00100000:3.0:1788572572.002789:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409280 00000100:00100000:3.0:1788572572.002853:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788572572.002864:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20568:x1875453495409280:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572572.003466:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20568:x1875453495409280:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 600us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572572.003475:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1788572572.020439:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.020564:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409408 00000100:00100000:0.0:1788572572.020575:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409408 00000100:00100000:0.0:1788572572.020638:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1788572572.020650:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20568:x1875453495409408:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572572.020974:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20568:x1875453495409408:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 324us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.020982:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:1.0:1788572572.024526:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572572.024790:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409536 00000100:00100000:3.0:1788572572.024800:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409536 00000100:00100000:3.0:1788572572.024861:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1788572572.024873:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+8:20549:x1875453495409536:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788572572.024891:0:23649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572572.024911:0:23649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024a600/0x977d9e7969c01d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb116ef expref: -99 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572572.024942:0:23649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024a600/0x977d9e7969c01d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116ef expref: 9 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572572.024953:0:23649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024a600/0x977d9e7969c01d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116ef expref: 9 pid: 23649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572572.024963:0:23649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a600, rc 0) 00000100:00100000:3.0:1788572572.025025:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+9:20549:x1875453495409536:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 155us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572572.025032:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:1.0:1788572572.034518:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572572.034704:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409664 00000100:00100000:3.0:1788572572.034716:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409664 00000100:00100000:3.0:1788572572.034842:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788572572.034855:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+9:20549:x1875453495409664:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788572572.034887:0:23651:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788572572.034913:0:23651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788572572.034918:0:23651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788572572.034922:0:23651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788572572.034925:0:23651:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:3.0:1788572572.039865:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+9:20549:x1875453495409664:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 5002us (5348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572572.039891:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:1.0:1788572572.047424:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.047549:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409792 00000100:00100000:0.0:1788572572.047559:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409792 00000100:00100000:0.0:1788572572.047786:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:0.0:1788572572.047798:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+9:20549:x1875453495409792:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572572.047814:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572572.047835:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb116f6 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572572.047865:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 10 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572572.047899:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 10 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572572.047910:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a5600, rc 0) 00000100:00100000:0.0:1788572572.048058:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20549:x1875453495409792:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 261us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.048066:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:1.0:1788572572.052811:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572572.052934:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495409920 00000100:00100000:3.0:1788572572.052944:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495409920 00000100:00100000:3.0:1788572572.052999:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1788572572.053009:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20549:x1875453495409920:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788572572.053335:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20549:x1875453495409920:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 326us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572572.053344:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1788572572.055516:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.055618:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410048 00000100:00100000:0.0:1788572572.055627:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410048 00000100:00100000:0.0:1788572572.055679:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:0.0:1788572572.055690:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20549:x1875453495410048:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788572572.055923:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20549:x1875453495410048:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 234us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.055931:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:1.0:1788572572.058883:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.058985:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410176 00000100:00100000:0.0:1788572572.058995:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410176 00000100:00100000:0.0:1788572572.059052:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:0.0:1788572572.059062:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20572:x1875453495410176:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572572.059375:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20572:x1875453495410176:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 312us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.059383:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788572572.061682:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572572.061830:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410304 00000100:00100000:3.0:1788572572.061841:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410304 00000100:00100000:3.0:1788572572.061898:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1788572572.061911:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20572:x1875453495410304:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572572.062173:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20572:x1875453495410304:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 264us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572572.062182:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:1.0:1788572572.068761:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.070745:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410432 00000100:00100000:0.0:1788572572.070761:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410432 00000100:00100000:0.0:1788572572.070832:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572572.070842:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875453495410432:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788572572.070891:0:23657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bf89ae46-999b-46d3-9a62-08dfe43909d0@192.168.202.2@tcp t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:0.0:1788572572.070946:0:23657:0:(genops.c:1385:class_connect()) connect: client bf89ae46-999b-46d3-9a62-08dfe43909d0, cookie 0x977d9e7969c01d14 00000004:00100000:0.0:1788572572.070978:0:23657:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788572572.070983:0:23657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000100:00080000:1.0:1788572572.137125:0:23657:0:(import.c:65:import_set_state_nolock()) ffff88c07bb17000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572572.137308:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2352:x1875453495410432:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 66463us (68557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572572.137324:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788572572.142893:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.142988:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410560 00000100:00100000:0.0:1788572572.142998:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410560 00000100:00100000:0.0:1788572572.143074:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788572572.143085:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:0:x1875453495410560:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788572572.143134:0:23656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788572572.143233:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:0:x1875453495410560:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.143240:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00080000:3.0:1788572572.143817:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572572.143935:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572572.144005:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410688 00000100:00100000:0.0:1788572572.144011:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410688 00000100:00100000:0.0:1788572572.144052:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788572572.144061:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20549:x1875453495410688:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788572572.144083:0:23657:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788572572.144159:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20549:x1875453495410688:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.144166:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572572.146035:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572572.146972:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410816 00000100:00100000:2.0:1788572572.146987:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410816 00000100:00100000:2.0:1788572572.147109:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1788572572.147121:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20549:x1875453495410816:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788572572.147209:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20549:x1875453495410816:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 89us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572572.147216:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572572.152148:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572572.152190:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572572.152223:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572572.152282:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495410944 00000100:00100000:1.0:1788572572.152292:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495410944 00000100:00100000:1.0:1788572572.152331:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411072 00000100:00100000:1.0:1788572572.152334:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411072 00000100:00100000:1.0:1788572572.152349:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788572572.152358:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495410944:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788572572.152391:0:24342:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bf89ae46-999b-46d3-9a62-08dfe43909d0@192.168.202.2@tcp t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:1.0:1788572572.152426:0:24342:0:(genops.c:1385:class_connect()) connect: client bf89ae46-999b-46d3-9a62-08dfe43909d0, cookie 0x977d9e7969c01d1b 00002000:00100000:1.0:1788572572.152439:0:24342:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf89ae46-999b-46d3-9a62-08dfe43909d0/ffff88c07bb15000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572572.152462:0:24342:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572572.152875:0:24342:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572572.152909:0:24342:0:(import.c:65:import_set_state_nolock()) ffff88c07bb14000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572572.152979:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2352:x1875453495410944:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 620us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572572.152987:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788572572.153006:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572572.153011:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495411072:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788572572.153030:0:24342:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bf89ae46-999b-46d3-9a62-08dfe43909d0@192.168.202.2@tcp t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:1.0:1788572572.153048:0:24342:0:(genops.c:1385:class_connect()) connect: client bf89ae46-999b-46d3-9a62-08dfe43909d0, cookie 0x977d9e7969c01d22 00002000:00100000:1.0:1788572572.153054:0:24342:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bf89ae46-999b-46d3-9a62-08dfe43909d0/ffff88c07bb12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572572.153060:0:24342:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572572.153292:0:24342:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572572.153309:0:24342:0:(import.c:65:import_set_state_nolock()) ffff88c07bb16800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572572.153335:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2352:x1875453495411072:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 321us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572572.153341:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572572.154337:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411200 00000100:00100000:0.0:1788572572.154350:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411200 00000100:00100000:0.0:1788572572.154407:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788572572.154417:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20549:x1875453495411200:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788572572.156427:0:23659:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1930us 00000004:00200000:3.0:1788572572.196580:0:23659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788572572.196742:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20549:x1875453495411200:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 42318us (44596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572572.196759:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572572.495020:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572572.495127:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411328 00000100:00100000:2.0:1788572572.495138:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411328 00000100:00100000:2.0:1788572572.495204:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788572572.495214:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20593:x1875453495411328:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:2.0:1788572572.495233:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572572.495437:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c01d29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11720 expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572572.495577:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01d30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572572.495594:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01d30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572572.495673:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01d30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572572.495710:0:23656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572572.495714:0:23656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572572.495752:0:23656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01d30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572572.495793:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c01d29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11720 expref: 8 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572572.495813:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01d30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11720 expref: 7 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572572.495822:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572572.495825:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572572.495829:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c800, rc 0) 00000100:00100000:2.0:1788572572.495938:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:20593:x1875453495411328:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 724us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572572.495946:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:3.0:1788572572.712826:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572573.736768:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572573.800665:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518459008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572573.800755:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572573.800996:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459008 00000100:00100000:3.0:1788572573.801005:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459008 00000100:00100000:3.0:1788572573.801073:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572573.801082:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518459008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572573.801129:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572573.801182:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518459008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572573.801190:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572573.801279:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518459008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572573.801455:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788572574.760444:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572574.882987:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572574.883298:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411456 00000100:00100000:2.0:1788572574.883308:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411456 00000100:00100000:3.0:1788572574.883420:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788572574.883435:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:20645:x1875453495411456:12345-192.168.202.2@tcp:41:lfs.0 00000004:00000024:3.0:1788572574.883486:0:23657:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788572574.883625:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:20645:x1875453495411456:12345-192.168.202.2@tcp:41:lfs.0 Request processed in 178us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572574.883633:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:0.0:1788572574.883791:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572574.889166:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572574.889262:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411584 00000100:00100000:3.0:1788572574.889273:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411584 00000100:00100000:3.0:1788572574.889354:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1788572574.889365:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20645:x1875453495411584:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:3.0:1788572574.889407:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788572574.889574:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572574.889657:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20645:x1875453495411584:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 293us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572574.889666:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1788572574.895641:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572574.895755:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411712 00000100:00100000:2.0:1788572574.895765:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411712 00000100:00100000:2.0:1788572574.895873:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788572574.895884:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20645:x1875453495411712:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:2.0:1788572574.895924:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788572574.896009:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:20645:x1875453495411712:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572574.896017:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00080000:3.0:1788572574.896910:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788572574.906889:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf89ae46-999b-46d3-9a62-08dfe43909d0 00000100:00100000:1.0:1788572575.184386:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.184781:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411840 00000100:00100000:2.0:1788572575.184793:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411840 00000100:00100000:2.0:1788572575.184854:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:2.0:1788572575.184866:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+10:20679:x1875453495411840:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788572575.184900:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572575.184933:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11727 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.184964:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11727 expref: 11 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.184977:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0d400/0x977d9e7969c01d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11727 expref: 11 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.184988:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d400, rc 0) 00000100:00100000:2.0:1788572575.185358:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20679:x1875453495411840:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 492us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.185380:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:2.0:1788572575.209770:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572575.209875:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495411968 00000100:00100000:0.0:1788572575.209888:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495411968 00000100:00100000:0.0:1788572575.209972:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:0.0:1788572575.209984:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20679:x1875453495411968:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788572575.210384:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20679:x1875453495411968:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 399us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.210393:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:1.0:1788572575.229060:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572575.229148:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412096 00000100:00100000:3.0:1788572575.229159:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412096 00000100:00100000:3.0:1788572575.229216:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:3.0:1788572575.229228:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20679:x1875453495412096:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788572575.229984:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20679:x1875453495412096:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 753us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572575.229996:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:1.0:1788572575.236400:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.236801:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412224 00000100:00100000:2.0:1788572575.236812:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412224 00000100:00100000:2.0:1788572575.236877:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:2.0:1788572575.236888:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20684:x1875453495412224:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572575.242761:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20684:x1875453495412224:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 5858us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.242778:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:2.0:1788572575.286608:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572575.286769:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412352 00000100:00100000:0.0:1788572575.286786:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412352 00000100:00100000:0.0:1788572575.286905:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:0.0:1788572575.286920:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20684:x1875453495412352:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572575.287405:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20684:x1875453495412352:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 485us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.287414:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:3.0:1788572575.291882:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.292233:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412480 00000100:00100000:2.0:1788572575.292244:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412480 00000100:00100000:2.0:1788572575.293224:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:2.0:1788572575.293238:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20679:x1875453495412480:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788572575.293290:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572575.293311:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0ca00/0x977d9e7969c01d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11751 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.293343:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0ca00/0x977d9e7969c01d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11751 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.293356:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0ca00/0x977d9e7969c01d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11751 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.293376:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572575.293431:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20679:x1875453495412480:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 197us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.293439:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:1.0:1788572575.304737:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572575.304940:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412608 00000100:00100000:0.0:1788572575.304955:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412608 00000100:00100000:0.0:1788572575.305033:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:0.0:1788572575.305047:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20679:x1875453495412608:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788572575.305081:0:23649:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788572575.305114:0:23649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788572575.305119:0:23649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788572575.305122:0:23649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788572575.305141:0:23649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:3.0:1788572575.308807:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20679:x1875453495412608:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 3752us (4072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572575.308823:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:3.0:1788572575.318345:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572575.318713:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412736 00000100:00100000:0.0:1788572575.318724:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412736 00000100:00100000:0.0:1788572575.318783:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1788572575.318794:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20679:x1875453495412736:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572575.318811:0:23651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572575.318832:0:23651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11758 expref: -99 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572575.318869:0:23651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 13 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572575.318884:0:23651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 13 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572575.318894:0:23651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4a00, rc 0) 00000100:00100000:0.0:1788572575.318967:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20679:x1875453495412736:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 174us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.318974:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:1.0:1788572575.322072:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572575.322168:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412864 00000100:00100000:3.0:1788572575.322180:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412864 00000100:00100000:3.0:1788572575.322242:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:2.0:1788572575.322541:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20679:x1875453495412864:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788572575.322976:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20679:x1875453495412864:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 511us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.322985:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:1.0:1788572575.325862:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572575.325978:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495412992 00000100:00100000:3.0:1788572575.325989:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495412992 00000100:00100000:3.0:1788572575.326048:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:3.0:1788572575.326059:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20679:x1875453495412992:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788572575.326764:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20679:x1875453495412992:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 701us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.326774:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:3.0:1788572575.331118:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.331378:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413120 00000100:00100000:2.0:1788572575.331389:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413120 00000100:00100000:2.0:1788572575.331622:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:2.0:1788572575.331634:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20688:x1875453495413120:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572575.331919:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20688:x1875453495413120:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 286us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.331929:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:0.0:1788572575.340132:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.340373:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413248 00000100:00100000:2.0:1788572575.340401:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413248 00000100:00100000:2.0:1788572575.340471:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:2.0:1788572575.340484:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20688:x1875453495413248:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572575.340976:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20688:x1875453495413248:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 494us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.340986:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:1.0:1788572575.350467:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.350875:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413376 00000100:00100000:2.0:1788572575.350887:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413376 00000100:00100000:2.0:1788572575.350940:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788572575.350951:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875453495413376:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788572575.350985:0:23656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 96693705-5e29-4404-974e-e904d01a815e@192.168.202.2@tcp t0 exp 0000000000000000 cur 796 last 0 00000020:00000080:2.0:1788572575.351029:0:23656:0:(genops.c:1385:class_connect()) connect: client 96693705-5e29-4404-974e-e904d01a815e, cookie 0x977d9e7969c01d4c 00000004:00100000:2.0:1788572575.351065:0:23656:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788572575.351209:0:23656:0:(import.c:65:import_set_state_nolock()) ffff88bf4737a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572575.351554:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96693705-5e29-4404-974e-e904d01a815e+6:2352:x1875453495413376:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 601us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.351563:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572575.362141:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.362390:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413632 00000100:00100000:2.0:1788572575.362401:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413632 00000100:00100000:2.0:1788572575.362524:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788572575.362536:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:20679:x1875453495413632:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788572575.362610:0:23658:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788572575.362704:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:20679:x1875453495413632:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 170us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.362713:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:3.0:1788572575.368698:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572575.368988:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572575.369089:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572575.369390:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413504 00000100:00100000:1.0:1788572575.369401:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413504 00000100:00100000:1.0:1788572575.369462:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413760 00000100:00100000:1.0:1788572575.369466:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413760 00000100:00100000:1.0:1788572575.369485:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572575.369495:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+7:0:x1875453495413504:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788572575.369529:0:23658:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788572575.369614:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+7:0:x1875453495413504:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 120us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.369622:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572575.369640:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572575.369646:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:20679:x1875453495413760:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788572575.369675:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:20679:x1875453495413760:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.369682:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572575.376812:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572575.376860:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572575.376898:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572575.376932:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495413888 00000100:00100000:1.0:1788572575.376942:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495413888 00000100:00100000:1.0:1788572575.376976:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414016 00000100:00100000:1.0:1788572575.376979:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414016 00000100:00100000:1.0:1788572575.376995:0:24341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788572575.377005:0:24341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875453495413888:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788572575.377036:0:24341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 96693705-5e29-4404-974e-e904d01a815e@192.168.202.2@tcp t0 exp 0000000000000000 cur 796 last 0 00000020:00000080:1.0:1788572575.377083:0:24341:0:(genops.c:1385:class_connect()) connect: client 96693705-5e29-4404-974e-e904d01a815e, cookie 0x977d9e7969c01d53 00002000:00100000:1.0:1788572575.377095:0:24341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 96693705-5e29-4404-974e-e904d01a815e/ffff88c047519000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572575.377121:0:24341:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788572575.377507:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788572575.377516:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495414016:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788572575.377535:0:24342:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 96693705-5e29-4404-974e-e904d01a815e@192.168.202.2@tcp t0 exp 0000000000000000 cur 796 last 0 00000020:00000080:2.0:1788572575.377558:0:24342:0:(genops.c:1385:class_connect()) connect: client 96693705-5e29-4404-974e-e904d01a815e, cookie 0x977d9e7969c01d5a 00002000:00100000:2.0:1788572575.377564:0:24342:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 96693705-5e29-4404-974e-e904d01a815e/ffff88bf47378000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572575.377571:0:24342:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572575.377651:0:24342:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788572575.377696:0:24342:0:(import.c:65:import_set_state_nolock()) ffff88c07c545000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572575.377779:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96693705-5e29-4404-974e-e904d01a815e+6:2352:x1875453495414016:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 262us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.377787:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00002000:00080000:1.0:1788572575.377954:0:24341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572575.377976:0:24341:0:(import.c:65:import_set_state_nolock()) ffff88c04751d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572575.377999:0:24341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96693705-5e29-4404-974e-e904d01a815e+6:2352:x1875453495413888:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 994us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.378006:0:24341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788572575.379628:0:23660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414144 00000100:00100000:3.0:1788572575.379643:0:23660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414144 00000100:00100000:3.0:1788572575.379704:0:23660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788572575.379715:0:23660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96693705-5e29-4404-974e-e904d01a815e+6:20679:x1875453495414144:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788572575.379797:0:23660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788572575.379886:0:23660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96693705-5e29-4404-974e-e904d01a815e+6:20679:x1875453495414144:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 173us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572575.379894:0:23660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1788572575.587403:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572575.587710:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414272 00000100:00100000:2.0:1788572575.587723:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414272 00000100:00100000:2.0:1788572575.587793:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572575.587803:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:20709:x1875453495414272:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:2.0:1788572575.587823:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572575.587843:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11782 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.587916:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.587931:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.587947:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572575.588006:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572575.588010:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572575.588028:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.588053:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 8 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.588073:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 7 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572575.588082:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572575.588085:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572575.588089:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572575.588336:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+7:20709:x1875453495414272:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 533us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572575.588345:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00010000:00010000:3.0:1788572575.784759:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572576.360722:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572576.360746:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518459136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572576.360804:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518459520:0@lo:400:kworker.0 00000100:00100000:0.0:1788572576.360814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572576.360837:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572576.360889:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518459264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572576.360890:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518459392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572576.360956:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518459648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572576.366028:0:24344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459136 00000100:00100000:1.0:1788572576.366050:0:24344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459136 00000100:00100000:0.0:1788572576.366751:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572576.366809:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518459776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572576.366855:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572576.366895:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459776 00000100:00100000:0.0:1788572576.366900:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459776 00000100:00100000:0.0:1788572576.366952:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572576.366961:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518459776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572576.367012:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518459776:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572576.367019:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572576.367071:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518459776:0@lo:400:kworker.0 00000100:00080000:0.0:1788572576.367093:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572576.367117:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459520 00000100:00100000:0.0:1788572576.367121:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459520 00000100:00100000:3.0:1788572576.367304:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459264 00000100:00100000:3.0:1788572576.367309:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459264 00000100:00100000:3.0:1788572576.367351:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572576.367358:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:3298:x1875453518459264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572576.367400:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:3298:x1875453518459264:12345-0@lo:400:kworker.0 Request processed in 43us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572576.367407:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572576.367441:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3220b4e-982e-4e01-8588-718942d18413:3298:1875453518459264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572576.368715:0:24344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788572576.368800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572576.368848:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518459904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572576.368889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572576.368915:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459904 00000100:00100000:3.0:1788572576.368922:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459904 00000100:00100000:3.0:1788572576.368954:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572576.368961:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572576.369007:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518459904:12345-0@lo:400:kworker.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572576.369013:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572576.369055:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518459904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572576.369100:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459392 00000100:00100000:3.0:1788572576.369103:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459392 00000100:00100000:3.0:1788572576.369131:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572576.369137:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518459392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572576.370550:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572576.370561:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518459520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572576.374859:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572576.374970:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572576.374977:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572576.374980:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572576.376462:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518459648 00000100:00100000:2.0:1788572576.376474:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518459648 00000100:00100000:2.0:1788572576.376535:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572576.376545:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518459648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572576.376624:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518459648:12345-0@lo:400:kworker.0 Request processed in 81us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572576.376646:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572576.376695:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518459648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572576.376726:0:24344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518459136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572576.376762:0:24344:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788572576.376815:0:24344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518459136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8089us (15999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572576.376822:0:24344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572576.376879:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518459136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572576.378306:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518459392:12345-0@lo:400:kworker.0 Request processed in 9163us (9500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572576.378338:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572576.378444:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788572576.379394:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518459520:12345-0@lo:400:kworker.0 Request processed in 8757us (18477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572576.379406:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572576.379522:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518459520:0@lo:400:kworker.0 00010000:00010000:0.0:1788572576.815686:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572576.907913:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf89ae46-999b-46d3-9a62-08dfe43909d0 00000001:00100000:3.0:1788572576.907928:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96693705-5e29-4404-974e-e904d01a815e 00000001:00100000:3.0:1788572577.462223:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf89ae46-999b-46d3-9a62-08dfe43909d0 00000001:00100000:3.0:1788572577.462243:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96693705-5e29-4404-974e-e904d01a815e 00010000:00010000:3.0:1788572577.832868:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572578.857389:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572578.923958:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518460032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572578.924023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572578.924131:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460032 00000100:00100000:0.0:1788572578.924139:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460032 00000100:00100000:0.0:1788572578.924207:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572578.924217:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518460032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572578.924292:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572578.924358:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518460032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572578.924365:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788572578.924528:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572578.924566:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518460032:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788572579.083070:0:25622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788572579.881074:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572579.977624:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96693705-5e29-4404-974e-e904d01a815e 00000100:00100000:0.0:1788572580.698951:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572580.699040:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414400 00000100:00100000:2.0:1788572580.699048:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414400 00000100:00100000:2.0:1788572580.699101:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:2.0:1788572580.699110:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2355:x1875453495414400:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572580.699200:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2355:x1875453495414400:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572580.699208:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:1.0:1788572580.707789:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572580.707967:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414528 00000100:00100000:3.0:1788572580.707977:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414528 00000100:00100000:3.0:1788572580.708053:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788572580.708064:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2355:x1875453495414528:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572580.708147:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2355:x1875453495414528:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572580.708165:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00080000:2.0:1788572580.708687:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572580.709377:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572580.709415:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572580.709470:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572580.709499:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572580.709523:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572580.709541:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414912 00000100:00100000:1.0:1788572580.709547:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414912 00000100:00100000:1.0:1788572580.709592:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1788572580.709600:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:2356:x1875453495414912:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572580.709646:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+6:2356:x1875453495414912:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572580.709654:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00080000:1.0:1788572580.709671:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572580.709847:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414784 00000100:00100000:0.0:1788572580.709852:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414784 00000100:00100000:0.0:1788572580.709887:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415040 00000100:00100000:0.0:1788572580.709890:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415040 00000100:00100000:0.0:1788572580.709905:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495414656 00000100:00100000:0.0:1788572580.709907:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495414656 00000100:00100000:0.0:1788572580.709920:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415168 00000100:00100000:0.0:1788572580.709922:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415168 00000100:00100000:0.0:1788572580.709936:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572580.709943:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2356:x1875453495414784:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572580.709974:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2356:x1875453495414784:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.709980:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572580.709995:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788572580.710002:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495415040:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572580.710024:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495415040:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.710030:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788572580.710041:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572580.710048:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2356:x1875453495414656:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572580.710080:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2356:x1875453495414656:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.710087:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572580.710107:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572580.710115:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495415168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572580.710136:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495415168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.710142:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00080000:1.0:1788572580.710560:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572580.710564:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572580.904391:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572581.294330:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788572581.483633:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518460288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572581.483708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572581.483758:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518460800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572581.483781:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572581.483872:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518460416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.483907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572581.483936:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572581.483941:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518460544:0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.483977:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460288 00000100:00100000:1.0:1788572581.483984:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460288 00000100:00100000:1.0:1788572581.484026:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460416 00000100:00100000:1.0:1788572581.484029:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460416 00000100:00100000:1.0:1788572581.484052:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572581.484060:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518460288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.484113:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518460288:12345-0@lo:400:kworker.0 Request processed in 53us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572581.484129:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572581.484145:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788572581.484151:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518460416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.484187:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518460416:12345-0@lo:400:kworker.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572581.484193:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788572581.484206:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572581.484209:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572581.484730:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518460160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572581.484766:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572581.485636:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518460672:0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.487751:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460800 00000100:00100000:1.0:1788572581.487766:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460800 00000100:00100000:1.0:1788572581.488279:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572581.488292:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518460800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572581.489311:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518460288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572581.489398:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572581.489410:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518460928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572581.489480:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572581.489515:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460928 00000100:00100000:3.0:1788572581.489520:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460928 00000100:00100000:3.0:1788572581.489560:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788572581.489578:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518460928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572581.489623:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788572581.489668:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518460928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572581.489675:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788572581.489717:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518460928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572581.494337:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460160 00000100:00100000:3.0:1788572581.494353:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460160 00000100:00100000:3.0:1788572581.494416:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788572581.494427:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518460160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572581.494536:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518460160:12345-0@lo:400:kworker.0 Request processed in 112us (9769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572581.494543:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788572581.497761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572581.497859:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518460160:0@lo:400:kworker.0 00000100:00100000:3.0:1788572581.498078:0:23656:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788572581.498090:0:23656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788572581.501598:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518460800:12345-0@lo:400:kworker.0 Request processed in 13290us (17795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572581.501614:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572581.501648:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460672 00000100:00100000:1.0:1788572581.501656:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460672 00000100:00100000:1.0:1788572581.501697:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788572581.501705:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518460672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.501780:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518460672:12345-0@lo:400:kworker.0 Request processed in 75us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572581.501787:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788572581.501938:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572581.502191:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518460672:0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.502540:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572581.502583:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518460416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.502708:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518460544 00000100:00100000:1.0:1788572581.502713:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518460544 00000100:00100000:1.0:1788572581.503544:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788572581.503557:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518460544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.503634:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518460544:12345-0@lo:400:kworker.0 Request processed in 80us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572581.503648:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572581.506684:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518460800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572581.511602:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518460544:0@lo:400:kworker.0 00010000:00010000:1.0:1788572581.928504:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572582.965401:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572583.445671:0:25771:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2ee53a50 20000000:00000080:2.0:1788572583.445692:0:25771:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88bf4556f000 uarg=0000000000000000 20000000:01000000:2.0:1788572583.445727:0:25771:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788572583.445733:0:25771:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788572583.445737:0:25771:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788572583.447087:0:25772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788572583.447494:0:25771:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788572583.462215:0:25771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788572583.463177:0:25771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463202:0:25771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463210:0:25771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463217:0:25771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463227:0:25771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463235:0:25771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 12 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463244:0:25771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463331:0:25771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 12 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463349:0:25771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 12 pid: 23651 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.463394:0:25771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461056:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572583.463505:0:25771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 12 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463515:0:25771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 12 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.463524:0:25771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461184:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572583.463554:0:25771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463562:0:25771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 18 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.463570:0:25771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461312:0@lo:104: 00000100:00100000:1.0:1788572583.463611:0:25771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572583.463651:0:25771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463659:0:25771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 18 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.463667:0:25771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461440:0@lo:104: 00000100:00100000:1.0:1788572583.463687:0:25771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572583.463705:0:25771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 18 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.463712:0:25771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 18 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.463726:0:25771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461568:0@lo:104: 00000100:00100000:1.0:1788572583.463751:0:25771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572583.463761:0:25771:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572583.463979:0:23641:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788572583.463994:0:23641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518461312 00000100:00100000:3.0:1788572583.464000:0:23641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518461312 00000100:00100000:3.0:1788572583.464039:0:23641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518461440 00000100:00100000:3.0:1788572583.464042:0:23641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518461440 00000100:00100000:3.0:1788572583.464065:0:23641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518461568 00000100:00100000:3.0:1788572583.464067:0:23641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518461568 00000100:00100000:3.0:1788572583.464081:0:23641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572583.464090:0:23641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3220b4e-982e-4e01-8588-718942d18413+5:25771:x1875453518461312:12345-0@lo:104: 00010000:00010000:3.0:1788572583.464105:0:23641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464181:0:23641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572583.464188:0:23641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3220b4e-982e-4e01-8588-718942d18413+5:25771:x1875453518461312:12345-0@lo:104: Request processed in 99us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572583.464195:0:23641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572583.464215:0:23641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572583.464220:0:23641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3220b4e-982e-4e01-8588-718942d18413+4:25771:x1875453518461440:12345-0@lo:104: 00010000:00010000:3.0:1788572583.464228:0:23641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464292:0:23641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788572583.464298:0:23641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3220b4e-982e-4e01-8588-718942d18413+4:25771:x1875453518461440:12345-0@lo:104: Request processed in 78us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572583.464305:0:23641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572583.464317:0:23641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572583.464323:0:23641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3220b4e-982e-4e01-8588-718942d18413+3:25771:x1875453518461568:12345-0@lo:104: 00010000:00010000:3.0:1788572583.464331:0:23641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464618:0:23641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788572583.464624:0:23641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3220b4e-982e-4e01-8588-718942d18413+3:25771:x1875453518461568:12345-0@lo:104: Request processed in 302us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572583.464630:0:23641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788572583.464670:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572583.464677:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464685:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91e00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572583.464696:0:23646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464705:0:23646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572583.464712:0:23646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572583.464718:0:23646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572583.464749:0:23646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464755:0:23646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572583.464773:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464781:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969c01bd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01bd9 expref: -99 pid: 25056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464795:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572583.464798:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464803:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572583.464806:0:23646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464813:0:23646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572583.464828:0:23646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572583.464833:0:23646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572583.464847:0:23646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464853:0:23646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572583.464868:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464875:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90800/0x977d9e7969c01a89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a90 expref: -99 pid: 24338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464885:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572583.464887:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464892:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90600 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572583.464895:0:23646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464902:0:23646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572583.464908:0:23646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572583.464912:0:23646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572583.464932:0:23646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464937:0:23646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572583.464944:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464950:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90600/0x977d9e7969c01a3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c01a43 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.464963:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572583.464965:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572583.464967:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572583.464974:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572583.464994:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518461696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572583.465029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572583.465077:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518461824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572583.465099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572583.465117:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572583.465122:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518461952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572583.465140:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572583.465165:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518461696 00000100:00100000:3.0:1788572583.465170:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518461696 00010000:00010000:3.0:1788572583.465194:0:23642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 19 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572583.465210:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518461824 00000100:00100000:3.0:1788572583.465214:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518461824 00010000:00010000:3.0:1788572583.465223:0:23642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 20 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572583.465933:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572583.465946:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3220b4e-982e-4e01-8588-718942d18413+20:3300:x1875453518461696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572583.465959:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572583.465965:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 20 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572583.465975:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 20 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572583.465992:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572583.466031:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3220b4e-982e-4e01-8588-718942d18413+20:3300:x1875453518461696:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572583.466037:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572583.466073:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572583.466080:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518461824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572583.466086:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572583.466091:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 19 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572583.466112:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 19 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572583.466122:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572583.466151:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518461824:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572583.466157:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572583.466204:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3220b4e-982e-4e01-8588-718942d18413:3300:1875453518461696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572583.466563:0:25771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0ce00/0x977d9e7969c01bd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c01bd2 expref: 18 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.466575:0:25771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461312:0@lo:104: 00010000:00010000:1.0:1788572583.466586:0:25771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0dc00/0x977d9e7969c01a90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c01a89 expref: 17 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.466594:0:25771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461440:0@lo:104: 00000100:00100000:1.0:1788572583.466602:0:25771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461568:0@lo:104: 00000100:00100000:3.0:1788572583.466777:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518461952 00000100:00100000:3.0:1788572583.466783:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518461952 00010000:00010000:3.0:1788572583.466805:0:23642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 17 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572583.466834:0:23642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572583.466842:0:23642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3220b4e-982e-4e01-8588-718942d18413+17:3297:x1875453518461952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572583.466850:0:23642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572583.466854:0:23642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 17 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.466863:0:23642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 17 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.466874:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0da00/0x977d9e7969c01a43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c01a3c expref: 17 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.466883:0:23642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572583.466912:0:23642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3220b4e-982e-4e01-8588-718942d18413+16:3297:x1875453518461952:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572583.466919:0:23642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572583.468506:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518461824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572583.468972:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572583.469007:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572583.469211:0:23643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415296 00000100:00100000:1.0:1788572583.469218:0:23643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415296 00010000:00010000:1.0:1788572583.469279:0:23643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 13 pid: 23651 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.469302:0:23643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415424 00000100:00100000:1.0:1788572583.469305:0:23643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415424 00010000:00010000:1.0:1788572583.469318:0:23643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 14 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572583.469331:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572583.469339:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f28dd17-6644-45dd-bf11-f8af88abec3c+14:2353:x1875453495415296:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572583.469362:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572583.469368:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 14 pid: 23651 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469396:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 14 pid: 23651 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469416:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572583.469466:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f28dd17-6644-45dd-bf11-f8af88abec3c+14:2353:x1875453495415296:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 127us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572583.469473:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572583.469491:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788572583.469497:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2353:x1875453495415424:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572583.469505:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572583.469508:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 13 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469516:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 13 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469527:0:23643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469535:0:23643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469548:0:23643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469555:0:23643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469562:0:23643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469574:0:23643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469579:0:23643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572583.469584:0:23643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469593:0:23643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469602:0:23643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572583.469613:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572583.469632:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2353:x1875453495415424:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 135us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572583.469639:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788572583.469671:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518461952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572583.470915:0:25771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bf410a4a00/0x977d9e7969c01d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11758 expref: 12 pid: 23651 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572583.470931:0:25771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461056:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572583.474171:0:25771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bf410a5600/0x977d9e7969c01d0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb116f6 expref: 11 pid: 23650 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572583.474192:0:25771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25771:1875453518461184:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572583.474236:0:25771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572583.474366:0:25771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572583.474376:0:25771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572583.474382:0:25771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076995000/0x977d9e7969c01d6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572583.976567:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572584.041602:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572584.041629:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518462080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572584.041703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.041884:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462080 00000100:00100000:0.0:1788572584.041893:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462080 00000100:00100000:0.0:1788572584.041969:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572584.041982:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518462080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572584.042031:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572584.042087:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518462080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.042095:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572584.042272:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518462080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572584.042457:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572584.855793:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572584.855882:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415552 00000100:00100000:3.0:1788572584.855892:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415552 00000100:00100000:3.0:1788572584.855960:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:3.0:1788572584.855974:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+11:20563:x1875453495415552:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572584.856004:0:23651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572584.856040:0:23651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024aa00/0x977d9e7969c01d76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11789 expref: -99 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.856075:0:23651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024aa00/0x977d9e7969c01d76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11789 expref: 12 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.856087:0:23651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024aa00/0x977d9e7969c01d76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11789 expref: 12 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.856097:0:23651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024aa00, rc 0) 00000100:00100000:3.0:1788572584.856164:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20563:x1875453495415552:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 193us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.856171:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788572584.860343:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572584.860670:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415680 00000100:00100000:3.0:1788572584.860681:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415680 00000100:00100000:3.0:1788572584.860749:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:3.0:1788572584.860760:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20563:x1875453495415680:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572584.861088:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20563:x1875453495415680:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 329us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.861096:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:1.0:1788572584.863766:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572584.863904:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415808 00000100:00100000:0.0:1788572584.863914:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415808 00000100:00100000:0.0:1788572584.863967:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788572584.863977:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20563:x1875453495415808:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572584.864378:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20563:x1875453495415808:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 400us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.864392:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 10000000:01000000:2.0:1788572584.873613:0:23653:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572584.873621:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c04751b000 from 10 10000000:01000000:2.0:1788572584.873655:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572584.873701:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.873712:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.873722:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572584.873747:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.873817:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.873882:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.874591:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462208 00000100:00100000:0.0:1788572584.874602:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462208 00000100:00100000:0.0:1788572584.874662:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788572584.874672:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+16:23653:x1875453518462208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572584.874686:0:23651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572584.874703:0:23651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bf410a4e00/0x977d9e7969c01d84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01d7d expref: -99 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.874730:0:23651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bf410a4e00/0x977d9e7969c01d84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01d7d expref: 17 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.874742:0:23651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bf410a4e00/0x977d9e7969c01d84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01d7d expref: 17 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.874751:0:23651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4e00, rc 0) 00000100:00100000:0.0:1788572584.874809:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+17:23653:x1875453518462208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.874815:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788572584.877236:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572584.877335:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572584.877420:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495415936 00000100:00100000:3.0:1788572584.877429:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495415936 00000100:00100000:3.0:1788572584.877480:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:3.0:1788572584.877489:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+12:20563:x1875453495415936:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572584.877507:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572584.877532:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024be00/0x977d9e7969c01d8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11790 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.877586:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024be00/0x977d9e7969c01d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11790 expref: 13 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.877599:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024be00/0x977d9e7969c01d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11790 expref: 13 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.877609:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024be00, rc 0) 00000100:00100000:3.0:1788572584.877670:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20563:x1875453495415936:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 181us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.877677:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 111 00010000:00010000:2.0:1788572584.878651:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01d84 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.878665:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01d84 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572584.878741:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.878787:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.878825:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572584.879334:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462336 00000100:00100000:3.0:1788572584.879342:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462336 00000100:00100000:3.0:1788572584.879389:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788572584.879398:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+17:23653:x1875453518462336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572584.879688:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+17:23653:x1875453518462336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.879696:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788572584.879731:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.879765:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.879806:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.879848:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.879917:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462464 00000100:00100000:0.0:1788572584.879922:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462464 00000100:00100000:0.0:1788572584.879971:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788572584.879979:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+17:23653:x1875453518462464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572584.880161:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+17:23653:x1875453518462464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.880168:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788572584.880959:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572584.881350:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572584.881481:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416064 00000100:00100000:3.0:1788572584.881486:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416064 00000100:00100000:3.0:1788572584.881528:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:3.0:1788572584.881536:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20563:x1875453495416064:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572584.881765:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20563:x1875453495416064:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 229us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.881772:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:0.0:1788572584.883839:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572584.884472:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416192 00000100:00100000:2.0:1788572584.884481:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416192 00000100:00100000:2.0:1788572584.884533:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:2.0:1788572584.884551:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0500af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20563:x1875453495416192:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.884780:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0500af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:20563:x1875453495416192:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 229us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572584.884787:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000040:00080000:1.0:1788572584.885312:0:25784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788572584.885621:0:23653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788572584.885648:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572584.885659:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01d84 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.885672:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0dc00/0x977d9e7969c01d7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01d84 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572584.885682:0:23653:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572584.885684:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf4530a800 from 10 10000000:01000000:2.0:1788572584.885687:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572584.885720:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.885728:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.885737:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572584.885760:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.885812:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.885869:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.886050:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462592 00000100:00100000:0.0:1788572584.886057:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462592 00000100:00100000:0.0:1788572584.886102:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572584.886121:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+17:23653:x1875453518462592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572584.886132:0:23651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572584.886146:0:23651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bf410a5200/0x977d9e7969c01d99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01d92 expref: -99 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.886170:0:23651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bf410a5200/0x977d9e7969c01d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01d92 expref: 18 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.886180:0:23651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bf410a5200/0x977d9e7969c01d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01d92 expref: 18 pid: 23651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.886189:0:23651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a5200, rc 0) 00000100:00100000:0.0:1788572584.886239:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518462592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.886245:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788572584.886814:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572584.886851:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01d99 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.886861:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01d99 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572584.886919:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572584.886953:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.886976:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.887096:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462720 00000100:00100000:0.0:1788572584.887101:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462720 00000100:00100000:0.0:1788572584.887134:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788572584.887141:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518462720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572584.887729:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518462720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 585us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.887737:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788572584.888273:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572584.888326:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572584.888375:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.888409:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572584.888704:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462848 00000100:00100000:2.0:1788572584.888710:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462848 00000100:00100000:2.0:1788572584.888748:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788572584.888756:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518462848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.889012:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518462848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572584.889019:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788572584.889447:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572584.891328:0:25785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788572584.895943:0:23653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788572584.895975:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572584.895986:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01d99 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.896010:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0ce00/0x977d9e7969c01d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01d99 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572584.896022:0:23653:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572584.896025:0:23653:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf47978000 from 10 10000000:01000000:2.0:1788572584.896028:0:23653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572584.896074:0:23653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.896083:0:23653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.896095:0:23653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572584.896133:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.896204:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.896325:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572584.897788:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518462976 00000100:00100000:3.0:1788572584.897802:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518462976 00000100:00100000:3.0:1788572584.897861:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788572584.897871:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+18:23653:x1875453518462976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572584.897889:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572584.897906:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024a200/0x977d9e7969c01da7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c01da0 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.897933:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024a200/0x977d9e7969c01da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c01da0 expref: 19 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.897944:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024a200/0x977d9e7969c01da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c01da0 expref: 19 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.897953:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a200, rc 0) 00000100:00100000:3.0:1788572584.898049:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518462976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.898057:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788572584.898308:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518462976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572584.898328:0:23653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01da7 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572584.898338:0:23653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c01da7 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572584.898403:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518463104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.898437:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.898486:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.898932:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518463104 00000100:00100000:1.0:1788572584.898939:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518463104 00000100:00100000:1.0:1788572584.898977:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788572584.898984:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518463104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572584.899300:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518463104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572584.899308:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788572584.899863:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518463104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.899910:0:23653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518463232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572584.899970:0:23653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.900015:0:23653:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572584.900186:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518463232 00000100:00100000:3.0:1788572584.900192:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518463232 00000100:00100000:3.0:1788572584.900231:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788572584.900239:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518463232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572584.900436:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3220b4e-982e-4e01-8588-718942d18413+19:23653:x1875453518463232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.900443:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788572584.901009:0:23653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3220b4e-982e-4e01-8588-718942d18413:23653:1875453518463232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572584.910098:0:25786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788572584.912057:0:23653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788572584.912091:0:23653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572584.912113:0:23653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01da7 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.912144:0:23653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0da00/0x977d9e7969c01da0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c01da7 expref: -99 pid: 23653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572584.959151:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572584.959217:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416320 00000100:00100000:2.0:1788572584.959229:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416320 00000100:00080000:1.0:1788572584.959284:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572584.959587:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788572584.959600:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:21168:x1875453495416320:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572584.959808:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572584.959843:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01dae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11797 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.959908:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.959920:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.959930:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.959940:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.959944:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.959948:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960293:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c01dc3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960303:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c01dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960310:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c01dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572584.960332:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572584.960343:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572584.960380:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c01dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960391:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960397:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960402:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960408:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024bc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572584.960412:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960419:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960430:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:3.0:1788572584.960434:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572584.960438:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960445:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960456:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960463:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960478:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960483:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ae00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572584.960498:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960506:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960514:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88c05009b200) 00010000:00010000:3.0:1788572584.960517:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572584.960520:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960526:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960560:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01dae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11797 expref: 8 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960573:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c01dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11797 expref: 7 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.960581:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c05009b400) 00010000:00010000:3.0:1788572584.960583:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572584.960586:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a800, rc 0) 00000100:00100000:3.0:1788572584.960667:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:21168:x1875453495416320:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1069us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.960684:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1788572584.964735:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572584.965035:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416576 00000100:00100000:3.0:1788572584.965144:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416576 00000100:00100000:3.0:1788572584.965214:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788572584.965224:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:21168:x1875453495416576:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572584.965243:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572584.965346:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01dca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1179e expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.965422:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.965436:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.965447:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.965471:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.965477:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.965483:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.966496:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c01ddf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.966526:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c01ddf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.966546:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c01ddf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572584.966558:0:23656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788572584.967328:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967342:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967353:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967359:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572584.967365:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967375:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967391:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c05009b400) 00010000:00010000:3.0:1788572584.967395:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572584.967399:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967406:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01dd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967420:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967431:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967437:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967441:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572584.967443:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967449:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967456:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88c05009ba00) 00010000:00010000:3.0:1788572584.967459:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572584.967461:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.967467:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01dd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.968030:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01dca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1179e expref: 10 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.968058:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c01ddf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1179e expref: 9 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.968067:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c05009b800) 00010000:00010000:3.0:1788572584.968069:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572584.968077:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b800, rc 0) 00000100:00100000:3.0:1788572584.968161:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21168:x1875453495416576:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2938us (3435us total) trans 17179869185 rc 0/0 00000100:00100000:3.0:1788572584.968170:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788572584.971771:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572584.971859:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416704 00000100:00100000:1.0:1788572584.971870:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416704 00000100:00100000:1.0:1788572584.971924:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788572584.971934:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21168:x1875453495416704:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788572584.972059:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21168:x1875453495416704:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572584.972067:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00010000:00010000:3.0:1788572585.000759:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572585.272573:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.272677:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416832 00000100:00100000:2.0:1788572585.272688:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416832 00000100:00100000:2.0:1788572585.272747:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788572585.272756:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21182:x1875453495416832:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572585.272776:0:25681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572585.272796:0:25681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117a5 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.272881:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.272896:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.272909:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.272924:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.272931:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.272937:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273440:0:25681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273451:0:25681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273456:0:25681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273462:0:25681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.273466:0:25681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273485:0:25681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273498:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572585.273501:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.273505:0:25681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273513:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273527:0:25681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273532:0:25681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273538:0:25681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273543:0:25681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.273546:0:25681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273551:0:25681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273558:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c0593efd00) 00010000:00010000:2.0:1788572585.273561:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.273564:0:25681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273580:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01dfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273615:0:25681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ded lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117a5 expref: 10 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273627:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572585.273629:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.273633:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117a5 expref: 10 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.273642:0:25681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572585.273702:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21182:x1875453495416832:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 945us (1141us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572585.273709:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1788572585.289794:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.290040:0:23666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495416960 00000100:00100000:3.0:1788572585.290050:0:23666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495416960 00000100:00100000:3.0:1788572585.290106:0:23666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788572585.290116:0:23666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21182:x1875453495416960:12345-192.168.202.2@tcp:700:lfs.0 00000100:00100000:3.0:1788572585.290298:0:23666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21182:x1875453495416960:12345-192.168.202.2@tcp:700:lfs.0 Request processed in 183us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.290306:0:23666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788572585.306195:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572585.306371:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495417216 00000100:00100000:1.0:1788572585.306382:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495417216 00000100:00100000:1.0:1788572585.306456:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1788572585.306466:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21182:x1875453495417216:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:1.0:1788572585.306538:0:23657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572585.306567:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01d30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11720 expref: 9 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572585.306589:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:1.0:1788572585.306594:0:23657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572585.307001:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572585.307030:0:23657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 5 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572585.307039:0:23657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572585.307074:0:23657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 5 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572585.307090:0:23657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 5 pid: 23658 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572585.307106:0:23657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fb81180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23657:1875453518463360:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572585.307198:0:23657:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572585.311416:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.311617:0:23643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495417344 00000100:00100000:0.0:1788572585.311627:0:23643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495417344 00010000:00010000:0.0:1788572585.311685:0:23643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 6 pid: 23658 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572585.311734:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572585.311746:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96693705-5e29-4404-974e-e904d01a815e+6:2355:x1875453495417344:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572585.311760:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572585.311767:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 6 pid: 23658 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.311779:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 6 pid: 23658 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.311802:0:23643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:0.0:1788572585.311807:0:23643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.311816:0:23643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.311824:0:23643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.311843:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572585.311890:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96693705-5e29-4404-974e-e904d01a815e+6:2355:x1875453495417344:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 147us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.311897:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:1.0:1788572585.313484:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572585.327155:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11782 expref: 5 pid: 23658 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572585.327181:0:23657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fb81180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23657:1875453518463360:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572585.327211:0:23657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.327223:0:23657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.327229:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.327701:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.327715:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.327793:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572585.336942:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572585.336968:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.337096:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.337103:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.337109:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.337115:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.337124:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.337141:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572585.337144:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.337149:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.337173:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c01e02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572585.337196:0:23657:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030e8cc45 reply state 000000004fceb05d transno 17179869186 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572585.337205:0:23657:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572585.338571:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+10:21182:x1875453495417216:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 32097us (32376us total) trans 17179869186 rc 0/0 00000100:00100000:2.0:1788572585.338983:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:3.0:1788572585.352041:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.352060:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.352068:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.352074:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.352080:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.352089:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.352107:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c0593efd00) 00010000:00010000:3.0:1788572585.352111:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.352129:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.352136:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01e09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572585.386775:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788572585.391989:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.393166:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495417472 00000100:00100000:3.0:1788572585.393181:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495417472 00000100:00100000:3.0:1788572585.393300:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788572585.393313:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:21183:x1875453495417472:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:3.0:1788572585.393338:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572585.393360:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117ac expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.393427:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01e17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.393452:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.393466:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572585.393500:0:23656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572585.393504:0:23656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572585.393568:0:23656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.393604:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117ac expref: 11 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.393810:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c01e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117ac expref: 10 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.393826:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:3.0:1788572585.393830:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572585.393834:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a400, rc 0) 00000100:00100000:3.0:1788572585.393893:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+10:21183:x1875453495417472:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 583us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.393900:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788572585.401595:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.401872:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495417600 00000100:00100000:3.0:1788572585.401884:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495417600 00000100:00100000:3.0:1788572585.401947:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572585.401957:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+10:21183:x1875453495417600:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:3.0:1788572585.401986:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572585.402007:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117b3 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402073:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402088:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402101:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402117:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402140:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402147:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402301:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01e33 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402310:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01e33 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402318:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01e33 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572585.402350:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572585.402354:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572585.402373:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01e33 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402385:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402392:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402398:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402403:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.402406:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402421:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402433:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:3.0:1788572585.402436:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.402452:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402458:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402471:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402476:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402482:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402487:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.402490:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402497:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402504:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c05009b200) 00010000:00010000:3.0:1788572585.402506:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.402510:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402526:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402558:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117b3 expref: 12 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402572:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01e33 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117b3 expref: 11 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.402589:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c05009b100) 00010000:00010000:3.0:1788572585.402592:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572585.402594:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ae00, rc 0) 00000100:00100000:3.0:1788572585.402660:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+11:21183:x1875453495417600:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 704us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.402666:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572585.419520:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.419823:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495417856 00000100:00100000:2.0:1788572585.419833:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495417856 00000100:00100000:2.0:1788572585.419896:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788572585.419907:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+11:21183:x1875453495417856:12345-192.168.202.2@tcp:36:chmod.0 00010000:00010000:2.0:1788572585.419965:0:25681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572585.420007:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c01e33 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117b3 expref: 11 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.420027:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c05009b100) 00010000:00010000:2.0:1788572585.420039:0:25681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572585.420064:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.420077:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.420088:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572585.420436:0:25681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007df59461 reply state 00000000c1e659cb transno 17179869187 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572585.420446:0:25681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788572585.420465:0:25681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788572585.420547:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+12:21183:x1875453495417856:12345-192.168.202.2@tcp:36:chmod.0 Request processed in 641us (1036us total) trans 17179869187 rc 0/0 00000100:00100000:2.0:1788572585.420555:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00010000:00010000:2.0:1788572585.424204:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.424225:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.424234:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.424240:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.424245:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.424292:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.424309:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572585.424312:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572585.424317:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.424323:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e3a lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572585.452637:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.452729:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495417984 00000100:00100000:3.0:1788572585.452740:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495417984 00000100:00100000:3.0:1788572585.452857:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788572585.452868:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+11:21184:x1875453495417984:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572585.452893:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572585.452917:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117ba expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453013:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453027:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453052:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453069:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453077:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453098:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453285:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01e56 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453295:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01e56 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453302:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01e56 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572585.453333:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572585.453338:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572585.453355:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01e56 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453368:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453375:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453394:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453399:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.453403:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453411:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453424:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:3.0:1788572585.453427:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.453432:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453439:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453453:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453459:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453464:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453469:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.453471:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453487:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453496:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c05009b200) 00010000:00010000:3.0:1788572585.453499:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.453501:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453507:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453541:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117ba expref: 13 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453555:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01e56 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117ba expref: 12 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.453562:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c05009b300) 00010000:00010000:3.0:1788572585.453564:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572585.453567:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024bc00, rc 0) 00000100:00100000:3.0:1788572585.453620:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+12:21184:x1875453495417984:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 754us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.453627:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788572585.457569:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.457646:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495418240 00000100:00100000:2.0:1788572585.457655:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495418240 00000100:00100000:2.0:1788572585.457707:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788572585.457716:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+12:21184:x1875453495418240:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572585.457735:0:25681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572585.457756:0:25681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117c1 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572585.457844:0:25681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572585.457958:0:25681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117c1 expref: 14 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.457983:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:2.0:1788572585.457987:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572585.457992:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117c1 expref: 14 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.458006:0:25681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572585.458459:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+13:21184:x1875453495418240:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 742us (897us total) trans 17179869188 rc 301/301 00000100:00100000:2.0:1788572585.458467:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:0.0:1788572585.465963:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.466773:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495418496 00000100:00100000:2.0:1788572585.466786:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495418496 00000100:00100000:2.0:1788572585.466847:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1788572585.466858:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+13:21184:x1875453495418496:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788572585.466917:0:23657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572585.466956:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c01e56 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117ba expref: 13 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.466983:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c05009b300) 00010000:00010000:2.0:1788572585.466995:0:23657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572585.467027:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.467040:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.467051:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572585.467318:0:23657:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000708fe046 reply state 00000000b3e1249e transno 17179869189 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572585.467328:0:23657:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788572585.467335:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788572585.467410:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:21184:x1875453495418496:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 554us (1456us total) trans 17179869189 rc 0/0 00000100:00100000:2.0:1788572585.467417:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00010000:00010000:3.0:1788572585.474321:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.474340:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.474364:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.474370:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.474376:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.474384:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.474400:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:3.0:1788572585.474404:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788572585.474408:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.474415:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01e6b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572585.475883:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572585.477825:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495418752 00000100:00100000:1.0:1788572585.477842:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495418752 00000100:00100000:1.0:1788572585.477953:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1788572585.477977:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+13:21184:x1875453495418752:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572585.478329:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:21184:x1875453495418752:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 365us (2453us total) trans 17179869190 rc 0/0 00000100:00100000:1.0:1788572585.478338:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788572585.482063:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.482206:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495419008 00000100:00100000:3.0:1788572585.482217:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495419008 00000100:00100000:3.0:1788572585.482304:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788572585.482315:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:21184:x1875453495419008:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572585.482339:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572585.482360:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117c8 expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482455:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482470:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482498:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482515:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482522:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482529:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572585.482661:0:23656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788572585.482760:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482767:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482773:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482778:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.482782:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482790:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482802:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:3.0:1788572585.482806:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.482818:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482825:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01e79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482839:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482845:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482849:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482854:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572585.482857:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482862:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482869:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c05009b200) 00010000:00010000:3.0:1788572585.482871:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572585.482874:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482879:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01e80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482913:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117c8 expref: 16 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482932:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:3.0:1788572585.482934:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572585.482938:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117c8 expref: 16 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.482946:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b400, rc 0) 00000100:00100000:3.0:1788572585.483016:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+15:21184:x1875453495419008:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 703us (962us total) trans 17179869191 rc 301/301 00000100:00100000:3.0:1788572585.483023:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:0.0:1788572585.486930:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.487049:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495419136 00000100:00100000:2.0:1788572585.487062:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495419136 00000100:00100000:2.0:1788572585.487140:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788572585.487151:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+15:21184:x1875453495419136:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572585.487175:0:23657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572585.487209:0:23657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01e8e lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117cf expref: -99 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.487349:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01e95 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.487363:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01e95 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.487375:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01e95 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572585.487399:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572585.487402:0:23657:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572585.487418:0:23657:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01e95 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.487459:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01e8e lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117cf expref: 17 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.487479:0:23657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01e95 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117cf expref: 16 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.487489:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efb00) 00010000:00010000:2.0:1788572585.487491:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572585.487495:0:23657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d600, rc 0) 00000100:00100000:2.0:1788572585.487557:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21184:x1875453495419136:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 408us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572585.487564:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788572585.493933:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.494044:0:23660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495419264 00000100:00100000:3.0:1788572585.494055:0:23660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495419264 00000100:00100000:3.0:1788572585.494122:0:23660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788572585.494134:0:23660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21184:x1875453495419264:12345-192.168.202.2@tcp:37:lfs.0 00000100:00100000:2.0:1788572585.499840:0:23660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21184:x1875453495419264:12345-192.168.202.2@tcp:37:lfs.0 Request processed in 5695us (5907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572585.499873:0:23660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788572585.503766:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572585.503836:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495419520 00000100:00100000:1.0:1788572585.503846:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495419520 00000100:00100000:1.0:1788572585.503920:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788572585.503929:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05088bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21184:x1875453495419520:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572585.504181:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05088bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+17:21184:x1875453495419520:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 250us (423us total) trans 17179869192 rc 0/0 00000100:00100000:1.0:1788572585.504197:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572585.614503:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572585.614599:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495419648 00000100:00100000:3.0:1788572585.614620:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495419648 00000100:00100000:3.0:1788572585.614681:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1788572585.614691:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+17:21190:x1875453495419648:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:3.0:1788572585.614726:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572585.614748:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117d6 expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572585.618194:0:23656:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3394us 00010000:00010000:0.0:1788572585.631917:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.631941:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.631953:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.631980:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.631987:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.631994:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632144:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4a00/0x977d9e7969c01eb1 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632154:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4a00/0x977d9e7969c01eb1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632161:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4a00/0x977d9e7969c01eb1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572585.632183:0:23656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788572585.632188:0:23656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572585.632225:0:23656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4a00/0x977d9e7969c01eb1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632238:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632245:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632280:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632287:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a5c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572585.632292:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632300:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632313:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:0.0:1788572585.632322:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572585.632328:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632334:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5c00/0x977d9e7969c01ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632345:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632351:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632357:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632361:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a4c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572585.632364:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632369:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632376:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88bf4564e200) 00010000:00010000:0.0:1788572585.632379:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572585.632381:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632386:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c01eaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632427:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c01e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117d6 expref: 19 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632455:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4a00/0x977d9e7969c01eb1 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117d6 expref: 18 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572585.632463:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efb00) 00010000:00010000:0.0:1788572585.632466:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788572585.632468:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4a00, rc 0) 00000100:00100000:0.0:1788572585.632544:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+18:21190:x1875453495419648:12345-192.168.202.2@tcp:101:dd.500 Request processed in 17853us (18049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.632553:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788572585.645446:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.645503:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.645587:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420032 00000100:00100000:2.0:1788572585.645598:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420032 00000100:00100000:2.0:1788572585.645678:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788572585.645689:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+18:21190:x1875453495420032:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:2.0:1788572585.645721:0:23657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572585.645725:0:23657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788572585.645756:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01e95 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117cf expref: 18 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.645778:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efb00) 00010000:00010000:2.0:1788572585.645783:0:23657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572585.645797:0:23657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01eb8 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117dd expref: -99 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.645978:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.645991:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.645999:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646012:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646018:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646034:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646739:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ecd lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646750:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ecd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646758:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ecd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572585.646767:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788572585.646797:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646805:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646811:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646817:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.646821:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646829:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646839:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efb00) 00010000:00010000:2.0:1788572585.646842:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.646852:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646858:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ebf lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572585.646870:0:23657:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c1e5fe reply state 000000001778d799 transno 17179869193 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572585.646879:0:23657:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572585.646910:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01eb8 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117dd expref: 20 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646923:0:23657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ecd lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117dd expref: 19 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.646931:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572585.646933:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788572585.646936:0:23657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572585.647014:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21190:x1875453495420032:12345-192.168.202.2@tcp:101:dd.500 Request processed in 1326us (1579us total) trans 17179869193 rc 0/0 00000100:00100000:2.0:1788572585.647022:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1788572585.648057:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495419776 00000100:00100000:3.0:1788572585.648071:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495419776 00000100:00100000:3.0:1788572585.648152:0:23642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788572585.648162:0:23642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:2353:x1875453495419776:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572585.648198:0:23642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572585.648218:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4a00/0x977d9e7969c01eb1 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117d6 expref: 20 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.648236:0:23642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efb00) 00010000:00010000:3.0:1788572585.648621:0:23642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572585.648685:0:23642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+19:2353:x1875453495419776:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 525us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.648693:0:23642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00010000:00010000:2.0:1788572585.655598:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.655629:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.655637:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.655664:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.655669:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.655677:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.655693:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff88c0593efa00) 00010000:00010000:2.0:1788572585.655696:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.655701:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.655707:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ec6 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572585.680424:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572585.680574:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420288 00000100:00100000:1.0:1788572585.680596:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420288 00000100:00100000:1.0:1788572585.680654:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1788572585.680664:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+18:21190:x1875453495420288:12345-192.168.202.2@tcp:35:dd.500 00000100:00100000:1.0:1788572585.681056:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+19:21190:x1875453495420288:12345-192.168.202.2@tcp:35:dd.500 Request processed in 392us (641us total) trans 17179869194 rc 0/0 00000100:00100000:1.0:1788572585.681064:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788572585.813625:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.813674:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.813715:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.813750:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.813769:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572585.813792:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572585.813947:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420544 00000100:00100000:1.0:1788572585.813987:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420544 00000100:00100000:1.0:1788572585.814044:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495421056 00000100:00100000:1.0:1788572585.814047:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495421056 00000100:00100000:1.0:1788572585.814061:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420672 00000100:00100000:1.0:1788572585.814064:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420672 00000100:00100000:1.0:1788572585.814077:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420928 00000100:00100000:1.0:1788572585.814079:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420928 00000100:00100000:1.0:1788572585.814095:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572585.814104:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2353:x1875453495420544:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572585.814178:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2353:x1875453495420544:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 74us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.814185:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572585.814202:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788572585.814209:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96693705-5e29-4404-974e-e904d01a815e+5:2353:x1875453495421056:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572585.814291:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96693705-5e29-4404-974e-e904d01a815e+5:2353:x1875453495421056:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 81us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.814298:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788572585.814311:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572585.814317:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2353:x1875453495420672:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572585.814339:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2353:x1875453495420672:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.814345:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572585.814356:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788572585.814362:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96693705-5e29-4404-974e-e904d01a815e+5:2353:x1875453495420928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572585.814384:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96693705-5e29-4404-974e-e904d01a815e+5:2353:x1875453495420928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.814389:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00080000:0.0:1788572585.815110:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572585.815115:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572585.815503:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420416 00000100:00100000:3.0:1788572585.815512:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420416 00000100:00100000:3.0:1788572585.815565:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788572585.815573:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2353:x1875453495420416:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572585.815627:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2353:x1875453495420416:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 55us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.815634:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:2.0:1788572585.816887:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495420800 00000100:00100000:2.0:1788572585.816898:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495420800 00000100:00100000:2.0:1788572585.816966:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788572585.816974:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96693705-5e29-4404-974e-e904d01a815e+5:2353:x1875453495420800:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572585.817045:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96693705-5e29-4404-974e-e904d01a815e+5:2353:x1875453495420800:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 71us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572585.817053:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1788572585.846763:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572585.847414:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495421312 00000100:00100000:2.0:1788572585.847435:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495421312 00000100:00100000:2.0:1788572585.847504:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788572585.847514:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+19:21200:x1875453495421312:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572585.847537:0:23657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572585.847573:0:23657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117e4 expref: -99 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.847647:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.847663:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.847687:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848406:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848484:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848496:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572585.848617:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572585.848724:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848732:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848739:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848746:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.848750:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848767:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848780:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:2.0:1788572585.848783:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.848787:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848794:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01ee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848809:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848815:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848820:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848825:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572585.848828:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848834:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848841:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c0593efa00) 00010000:00010000:2.0:1788572585.848844:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572585.848847:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848864:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01ee9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848908:0:23657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01edb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117e4 expref: 21 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848917:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:2.0:1788572585.848919:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572585.848923:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117e4 expref: 21 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.848932:0:23657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572585.850610:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21200:x1875453495421312:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 3084us (3844us total) trans 17179869195 rc 301/301 00000100:00100000:2.0:1788572585.850624:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788572585.854977:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572585.856119:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495421568 00000100:00100000:1.0:1788572585.856133:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495421568 00000100:00100000:1.0:1788572585.856211:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572585.856230:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21200:x1875453495421568:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572585.857634:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+21:21200:x1875453495421568:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 1406us (2661us total) trans 17179869196 rc 0/0 00000100:00100000:1.0:1788572585.857646:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788572586.017205:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572586.017545:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495421696 00000100:00100000:2.0:1788572586.017555:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495421696 00000100:00100000:2.0:1788572586.017633:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788572586.017643:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+21:21206:x1875453495421696:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:2.0:1788572586.017687:0:25681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572586.017716:0:25681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117eb expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017773:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017785:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017806:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017817:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017821:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017825:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017908:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01f0c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017913:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01f0c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017916:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01f0c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572586.017931:0:25681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572586.017933:0:25681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572586.017960:0:25681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01f0c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017973:0:25681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017980:0:25681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.017997:0:25681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018003:0:25681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572586.018007:0:25681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018016:0:25681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018028:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:2.0:1788572586.018031:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572586.018035:0:25681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018042:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018055:0:25681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572586.018219:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572586.018363:0:25681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018367:0:25681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018371:0:25681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572586.018372:0:25681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018384:0:25681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018391:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff88c0593efa00) 00010000:00010000:2.0:1788572586.018392:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572586.018394:0:25681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018398:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018478:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01ef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117eb expref: 23 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018489:0:25681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c01f0c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117eb expref: 22 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.018496:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:2.0:1788572586.018499:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788572586.018501:0:25681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d600, rc 0) 00000100:00100000:2.0:1788572586.018611:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+22:21206:x1875453495421696:12345-192.168.202.2@tcp:101:dd.500 Request processed in 969us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572586.018617:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00010000:00010000:3.0:1788572586.024746:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572586.051815:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572586.053301:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495421952 00000100:00100000:3.0:1788572586.053320:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495421952 00000100:00100000:3.0:1788572586.053399:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1788572586.053410:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+22:21206:x1875453495421952:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:3.0:1788572586.053439:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572586.053462:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f13 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117f2 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.053609:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f1a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.053626:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.053638:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572586.053650:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788572586.053803:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f13 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117f2 expref: 25 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.053824:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f1a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117f2 expref: 24 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.053833:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572586.053836:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572586.053839:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:3.0:1788572586.053919:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+24:21206:x1875453495421952:12345-192.168.202.2@tcp:101:dd.500 Request processed in 510us (2114us total) trans 17179869197 rc 0/0 00000100:00100000:3.0:1788572586.053927:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1788572586.073335:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572586.074309:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495422208 00000100:00100000:3.0:1788572586.074323:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495422208 00000100:00100000:3.0:1788572586.074387:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1788572586.074399:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+24:21206:x1875453495422208:12345-192.168.202.2@tcp:35:dd.500 00000100:00100000:3.0:1788572586.074661:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+25:21206:x1875453495422208:12345-192.168.202.2@tcp:35:dd.500 Request processed in 262us (1336us total) trans 17179869198 rc 0/0 00000100:00100000:3.0:1788572586.074685:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572586.204121:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572586.204286:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495422464 00000100:00100000:2.0:1788572586.204301:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495422464 00000100:00100000:2.0:1788572586.204372:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788572586.204383:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+25:21212:x1875453495422464:12345-192.168.202.2@tcp:36:truncate.500 00010000:00010000:2.0:1788572586.204493:0:25681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572586.204531:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f1a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117f2 expref: 25 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.204558:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572586.204565:0:25681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572586.204835:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.204853:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.204866:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572586.204959:0:25681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869199 00000004:00010000:2.0:1788572586.204988:0:25681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070e52b4c reply state 000000009e2341b9 transno 17179869200 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572586.204998:0:25681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572586.205115:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+27:21212:x1875453495422464:12345-192.168.202.2@tcp:36:truncate.500 Request processed in 732us (1012us total) trans 17179869200 rc 0/0 00000100:00100000:2.0:1788572586.205123:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000020:00080000:2.0:1788572586.205127:0:25681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788572586.208746:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.208764:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.208772:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.208777:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572586.208782:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.208790:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.208807:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572586.208810:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572586.208816:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.208822:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f28 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572586.334170:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572586.334410:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495422592 00000100:00100000:3.0:1788572586.334420:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495422592 00000100:00100000:3.0:1788572586.334535:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1788572586.334546:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+26:21218:x1875453495422592:12345-192.168.202.2@tcp:101:truncate.500 00010000:00010000:3.0:1788572586.334574:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572586.334614:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f2f lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb117f9 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334681:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334704:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334715:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334725:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334729:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334733:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334860:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334869:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334876:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572586.334905:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 256 00000004:00200000:3.0:1788572586.334910:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572586.334941:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334960:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.334969:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335073:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335079:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335083:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572586.335086:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335092:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335101:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:3.0:1788572586.335104:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572586.335107:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335111:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c01f36 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335121:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335124:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335134:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335139:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572586.335142:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335148:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335165:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff88c05009b200) 00010000:00010000:3.0:1788572586.335168:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572586.335171:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335177:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c01f3d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335211:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f2f lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117f9 expref: 28 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335226:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117f9 expref: 27 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.335234:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:3.0:1788572586.335236:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572586.335239:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:3.0:1788572586.335354:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+27:21218:x1875453495422592:12345-192.168.202.2@tcp:101:truncate.500 Request processed in 810us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572586.335366:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788572586.339066:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572586.339186:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495422848 00000100:00100000:2.0:1788572586.339199:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495422848 00000100:00100000:2.0:1788572586.339401:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788572586.339412:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+27:21218:x1875453495422848:12345-192.168.202.2@tcp:36:truncate.500 00010000:00010000:2.0:1788572586.339474:0:25681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572586.339510:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c01f44 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117f9 expref: 27 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.339529:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572586.339534:0:25681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572586.340208:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.340226:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.340237:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572586.340546:0:25681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869201 00000004:00010000:2.0:1788572586.340575:0:25681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dd821e3 reply state 000000002f7d27d5 transno 17179869202 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572586.340585:0:25681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572586.340691:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+29:21218:x1875453495422848:12345-192.168.202.2@tcp:36:truncate.500 Request processed in 1280us (1636us total) trans 17179869202 rc 0/0 00000100:00100000:2.0:1788572586.340700:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000020:00080000:2.0:1788572586.340705:0:25681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572586.350674:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.350694:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.350702:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.350728:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572586.350733:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.350740:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.350758:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572586.350760:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572586.350765:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.350772:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f4b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572586.426389:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572586.426648:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495423104 00000100:00100000:2.0:1788572586.426657:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495423104 00000100:00100000:2.0:1788572586.426710:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1788572586.426720:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+28:21224:x1875453495423104:12345-192.168.202.2@tcp:101:dd.500 00010000:00010000:2.0:1788572586.426745:0:23657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572586.426768:0:23657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f52 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11800 expref: -99 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.426962:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.426976:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.426986:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427004:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427008:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427012:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427060:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f67 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427067:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f67 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427073:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f67 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572586.427083:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00010000:00010000:2.0:1788572586.427187:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427195:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427202:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427207:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572586.427212:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427229:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427241:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:2.0:1788572586.427244:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572586.427292:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427299:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01f59 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427312:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427318:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427323:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427328:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572586.427331:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427337:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427343:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff88c0593efa00) 00010000:00010000:2.0:1788572586.427345:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572586.427348:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427362:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01f60 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427529:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01f52 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11800 expref: 31 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427541:0:23657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f67 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11800 expref: 30 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572586.427546:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572586.427547:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788572586.427549:0:23657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572586.427606:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+30:21224:x1875453495423104:12345-192.168.202.2@tcp:101:dd.500 Request processed in 887us (1226us total) trans 17179869203 rc 0/0 00000100:00100000:2.0:1788572586.427611:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1788572586.431952:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572586.432225:0:23644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495423232 00000100:00100000:0.0:1788572586.432237:0:23644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495423232 00000100:00100000:1.0:1788572586.433016:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572586.433287:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495423488 00000100:00100000:3.0:1788572586.433294:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495423488 00000100:00100000:3.0:1788572586.433355:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788572586.433363:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+31:21224:x1875453495423488:12345-192.168.202.2@tcp:36:dd.500 00010000:00010000:3.0:1788572586.433601:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.433615:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572586.433624:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572586.433661:0:23656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869204 00000004:00010000:3.0:1788572586.433676:0:23656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e3553ee reply state 000000007f1d6c5a transno 17179869205 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572586.433684:0:23656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572586.433767:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+34:21224:x1875453495423488:12345-192.168.202.2@tcp:36:dd.500 Request processed in 404us (752us total) trans 17179869205 rc 0/0 00000100:00100000:3.0:1788572586.433772:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000020:00080000:3.0:1788572586.433776:0:23656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788572586.435356:0:23644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1788572586.435369:0:23644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fb81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+33:2353:x1875453495423232:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572586.435385:0:23644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572586.435416:0:23644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c01f67 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11800 expref: 33 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435437:0:23644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:0.0:1788572586.435442:0:23644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572586.435497:0:23644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fb81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+32:2353:x1875453495423232:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 129us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572586.435504:0:23644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00010000:00010000:0.0:1788572586.435727:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435737:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435744:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435751:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572586.435755:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435765:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435775:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:0.0:1788572586.435792:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572586.435796:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.435802:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c01f75 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572586.437441:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572586.437560:0:23660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495423744 00000100:00100000:2.0:1788572586.437571:0:23660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495423744 00000100:00100000:2.0:1788572586.437619:0:23660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788572586.437629:0:23660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+31:21224:x1875453495423744:12345-192.168.202.2@tcp:35:dd.500 00000100:00100000:2.0:1788572586.438008:0:23660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+32:21224:x1875453495423744:12345-192.168.202.2@tcp:35:dd.500 Request processed in 379us (574us total) trans 17179869206 rc 0/0 00000100:00100000:2.0:1788572586.438016:0:23660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572586.506400:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572586.506646:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495424000 00000100:00100000:0.0:1788572586.506657:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495424000 00000100:00100000:0.0:1788572586.506721:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:0.0:1788572586.506732:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+32:21234:x1875453495424000:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572586.506756:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572586.506778:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c01f7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11807 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572586.506867:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788572586.506999:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c01f7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11807 expref: 34 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.507010:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c05009ba00) 00010000:00010000:0.0:1788572586.507013:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572586.507017:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c01f7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11807 expref: 34 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572586.507026:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a5000, rc 0) 00000100:00100000:0.0:1788572586.507080:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+33:21234:x1875453495424000:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 351us (689us total) trans 17179869207 rc 301/301 00000100:00100000:0.0:1788572586.507087:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1788572586.510685:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572586.510758:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495424256 00000100:00100000:3.0:1788572586.510768:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495424256 00000100:00100000:3.0:1788572586.510825:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788572586.510833:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+33:21234:x1875453495424256:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788572586.511071:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+34:21234:x1875453495424256:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 237us (394us total) trans 17179869208 rc 0/0 00000100:00100000:3.0:1788572586.511078:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788572586.600658:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518463616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572586.600743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572586.600798:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518464128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572586.600827:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572586.600854:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572586.600860:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518463744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572586.600883:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572586.600902:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518464256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572586.600933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572586.600977:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518463744 00000100:00100000:3.0:1788572586.600985:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518463744 00000100:00100000:3.0:1788572586.601043:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572586.601052:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518463744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572586.601103:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518463744:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572586.601111:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788572586.601143:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572586.601327:0:23651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518463616 00000100:00100000:1.0:1788572586.601332:0:23651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518463616 00000100:00100000:1.0:1788572586.601363:0:23651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788572586.601371:0:23651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518463616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572586.601405:0:23651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518463616:12345-0@lo:400:kworker.0 Request processed in 36us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572586.601411:0:23651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788572586.601491:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518463488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572586.601524:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572586.601542:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518464000:0@lo:400:kworker.0 00000100:00100000:2.0:1788572586.601584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572586.601601:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572586.601607:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518463872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572586.601627:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572586.601784:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518463488 00000100:00100000:0.0:1788572586.601796:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518463488 00000100:00100000:0.0:1788572586.601843:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572586.601852:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518463488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572586.601883:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788572586.601933:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518463488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572586.601939:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788572586.601957:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572586.601982:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518464128 00000100:00100000:0.0:1788572586.601986:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518464128 00000100:00100000:0.0:1788572586.602015:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518464256 00000100:00100000:0.0:1788572586.602019:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518464256 00000100:00100000:0.0:1788572586.602031:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518464000 00000100:00100000:0.0:1788572586.602034:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518464000 00000100:00100000:0.0:1788572586.602046:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572586.602052:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518464128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572586.602085:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518464128:12345-0@lo:400:kworker.0 Request processed in 33us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572586.602091:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572586.602102:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572586.602107:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518464256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572586.602146:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518464256:12345-0@lo:400:kworker.0 Request processed in 39us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572586.602159:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572586.602172:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572586.602178:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518464000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572586.602206:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518464000:12345-0@lo:400:kworker.0 Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572586.602219:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788572586.602235:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572586.602575:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518463744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572586.602589:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518464256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572586.602600:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518463616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572586.602617:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572586.604301:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518463488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572586.604317:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518464000:0@lo:400:kworker.0 00000100:00100000:2.0:1788572586.604370:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518463872 00000100:00100000:2.0:1788572586.604375:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518463872 00000100:00100000:2.0:1788572586.607369:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572586.607391:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518463872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572586.607497:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518463872:12345-0@lo:400:kworker.0 Request processed in 116us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572586.607504:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572586.607558:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518463872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572587.046160:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.050175:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495424384 00000100:00100000:0.0:1788572587.050194:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495424384 00000100:00100000:0.0:1788572587.050297:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788572587.050309:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+34:21271:x1875453495424384:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:0.0:1788572587.050334:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572587.050354:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c01f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1180e expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.050443:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c01f91 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.050457:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c01f91 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.050467:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c01f91 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572587.050505:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788572587.050509:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572587.050778:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c01f91 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.050807:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c01f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1180e expref: 36 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.050822:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c01f91 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1180e expref: 35 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.050845:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:0.0:1788572587.050848:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572587.050851:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4000, rc 0) 00000100:00100000:0.0:1788572587.050930:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+35:21271:x1875453495424384:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 622us (4802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.050938:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00010000:00010000:3.0:1788572587.051479:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572587.054833:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.055136:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495424512 00000100:00100000:1.0:1788572587.055148:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495424512 00000100:00100000:1.0:1788572587.055234:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:1.0:1788572587.055628:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+35:21271:x1875453495424512:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:1.0:1788572587.055666:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572587.055698:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01f98 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11815 expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055783:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055800:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055832:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572587.055877:0:23656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788572587.055881:0:23656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572587.055917:0:23656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055930:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055954:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01f98 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11815 expref: 37 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055973:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11815 expref: 36 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.055982:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:1.0:1788572587.055985:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572587.055989:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572587.056065:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21271:x1875453495424512:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 821us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.056072:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:1.0:1788572587.074447:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.074538:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495424768 00000100:00100000:2.0:1788572587.074550:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495424768 00000100:00100000:2.0:1788572587.074615:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1788572587.074627:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21271:x1875453495424768:12345-192.168.202.2@tcp:101:lfs.500 00010000:00010000:2.0:1788572587.074649:0:23657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572587.074686:0:23657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fa6 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1181c expref: -99 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.074810:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01fad lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.074825:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01fad lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.074854:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01fad lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572587.074869:0:23657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788572587.075189:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fa6 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1181c expref: 39 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.075215:0:23657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01fad lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1181c expref: 38 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.075224:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:2.0:1788572587.075226:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572587.075230:0:23657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c800, rc 0) 00000100:00100000:2.0:1788572587.075337:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+38:21271:x1875453495424768:12345-192.168.202.2@tcp:101:lfs.500 Request processed in 711us (903us total) trans 17179869209 rc 0/0 00000100:00100000:2.0:1788572587.075345:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:3.0:1788572587.080975:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.081183:0:23642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425024 00000100:00100000:0.0:1788572587.081196:0:23642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425024 00000100:00100000:0.0:1788572587.081327:0:23642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788572587.081342:0:23642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+38:21271:x1875453495425024:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:0.0:1788572587.081360:0:23642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788572587.081392:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c01fad lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1181c expref: 38 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.081420:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c01f9f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11815 expref: 37 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.081434:0:23642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01ecd lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb117dd expref: 36 pid: 23657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.081446:0:23642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593ef800) 00010000:00010000:0.0:1788572587.081456:0:23642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572587.081522:0:23642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+35:21271:x1875453495425024:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 183us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.081543:0:23642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788572587.090668:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.090781:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425152 00000100:00100000:2.0:1788572587.090792:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425152 00000100:00100000:2.0:1788572587.090861:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788572587.090872:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+35:21271:x1875453495425152:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:2.0:1788572587.091024:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.091042:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.091055:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572587.091900:0:25681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572587.092050:0:25681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 64 off8448 00000040:00080000:2.0:1788572587.092119:0:25681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 136 off8328 00000100:00100000:2.0:1788572587.092230:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+35:21271:x1875453495425152:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1357us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572587.092240:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:3.0:1788572587.094868:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.094993:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425280 00000100:00100000:0.0:1788572587.095004:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425280 00000100:00100000:0.0:1788572587.095063:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:0.0:1788572587.095074:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+35:21271:x1875453495425280:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572587.095095:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572587.095117:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11823 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.095194:0:23658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 2/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.095207:0:23658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 4/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 36 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.095226:0:23658:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.095239:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 36 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.095277:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:0.0:1788572587.095281:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572587.095284:0:23658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 36 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.095293:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4600, rc 0) 00000100:00100000:0.0:1788572587.095369:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21271:x1875453495425280:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 297us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.095376:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000040:00080000:1.0:1788572587.432634:0:23689:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788572587.432645:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572587.432686:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:1.0:1788572587.432693:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1788572587.432846:0:23689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23689:1875453518464384:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572587.433041:0:23689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572587.452208:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.452301:0:23668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425408 00000100:00100000:0.0:1788572587.452310:0:23668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425408 00000100:00100000:0.0:1788572587.452372:0:23668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788572587.452383:0:23668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495425408:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788572587.452704:0:23689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23689:1875453518464384:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788572587.457954:0:23668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21272:x1875453495425408:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 5559us (5744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.457970:0:23668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788572587.460330:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.460437:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425536 00000100:00100000:2.0:1788572587.460447:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425536 00000100:00100000:2.0:1788572587.460712:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1788572587.460724:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21272:x1875453495425536:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788572587.460757:0:25681:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788572587.460855:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21272:x1875453495425536:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572587.460863:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788572587.464583:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.464936:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425664 00000100:00100000:0.0:1788572587.464946:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425664 00000100:00100000:0.0:1788572587.465009:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1788572587.465019:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21272:x1875453495425664:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788572587.465108:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465127:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465141:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465157:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465164:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465191:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465215:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465223:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465230:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572587.465288:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788572587.465292:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572587.465307:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465320:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465326:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465332:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465338:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a5800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.465342:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465349:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465367:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c05009b800) 00010000:00010000:0.0:1788572587.465370:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572587.465375:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465381:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5800/0x977d9e7969c01fc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465395:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465401:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465407:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465832:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a4400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.465837:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465845:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465854:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xbe39250a (ffff88bf4564e200) 00010000:00010000:0.0:1788572587.465857:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572587.465860:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465866:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c01fd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465902:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465908:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465912:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465916:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a4200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.465919:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465924:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465932:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:0.0:1788572587.465934:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572587.465937:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.465942:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4200/0x977d9e7969c01fd7 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572587.466022:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21272:x1875453495425664:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 1002us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.466030:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:3.0:1788572587.469949:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.470120:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495425920 00000100:00100000:2.0:1788572587.470140:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495425920 00000100:00100000:2.0:1788572587.470209:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1788572587.470220:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+36:21272:x1875453495425920:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572587.470242:0:25681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572587.470298:0:25681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01fde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1182a expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470412:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470431:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470457:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572587.470470:0:25681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788572587.470575:0:25681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470584:0:25681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470592:0:25681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470597:0:25681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572587.470601:0:25681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470609:0:25681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470622:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:2.0:1788572587.470625:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572587.470630:0:25681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470636:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c01fe5 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470854:0:25681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01fde lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1182a expref: 38 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470877:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c05009b800) 00010000:00010000:2.0:1788572587.470880:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572587.470885:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c01fde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1182a expref: 38 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.470907:0:25681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572587.470966:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495425920:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 748us (1039us total) trans 17179869210 rc 301/301 00000100:00100000:2.0:1788572587.470974:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1788572587.479765:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.479864:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495426048 00000100:00100000:1.0:1788572587.479876:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495426048 00000100:00100000:1.0:1788572587.479952:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1788572587.479963:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495426048:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788572587.480000:0:23658:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788572587.480125:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495426048:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 164us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.480133:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788572587.496777:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.496851:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495426304 00000100:00100000:1.0:1788572587.496862:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495426304 00000100:00100000:1.0:1788572587.496934:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:1.0:1788572587.496947:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495426304:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572587.496972:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572587.496975:0:23656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572587.497004:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c01f91 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1180e expref: 37 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.497023:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:1.0:1788572587.497029:0:23656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572587.497044:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01ff3 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11831 expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572587.498087:0:23656:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x44:0x0], count =30 00000004:00080000:1.0:1788572587.498103:0:23656:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x44:0x0]+30 in llog 00000004:00080000:1.0:1788572587.498154:0:23656:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62:0x0], index 0: 0 00010000:00010000:1.0:1788572587.501039:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01ffa lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.501074:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01ffa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.501087:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01ffa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.501157:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969c01ff3 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11831 expref: 39 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.501177:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01ffa lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11831 expref: 38 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.501186:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572587.501189:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572587.501193:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995200, rc 0) 00000100:00100000:1.0:1788572587.501298:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+38:21272:x1875453495426304:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4352us (4531us total) trans 17179869211 rc 0/0 00000100:00100000:1.0:1788572587.501306:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788572587.504849:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.506091:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495426560 00000100:00100000:1.0:1788572587.506104:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495426560 00000100:00100000:1.0:1788572587.506174:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:1.0:1788572587.506186:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+38:21272:x1875453495426560:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572587.506265:0:23658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572587.506293:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c01ffa lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11831 expref: 38 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506325:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572587.506335:0:23658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572587.506360:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506373:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506383:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506398:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506405:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506412:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506478:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506486:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506493:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.506499:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572587.507033:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507050:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507061:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:1.0:1788572587.507064:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572587.507068:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507075:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02008 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507086:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507092:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507097:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507102:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572587.507104:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507111:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507117:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xf6a57c9d (ffff88c058eac300) 00010000:00010000:1.0:1788572587.507120:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572587.507123:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.507139:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0200f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xf6a57c9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572587.507312:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495426560:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1126us (2472us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572587.507320:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1788572587.521149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.521236:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495426688 00000100:00100000:2.0:1788572587.521284:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495426688 00000100:00100000:2.0:1788572587.521350:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1788572587.521361:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+37:21272:x1875453495426688:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572587.521384:0:25681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572587.521422:0:25681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c02016 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11838 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.521474:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.521499:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.521518:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.521629:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c02016 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 39 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.521659:0:25681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 38 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.521668:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572587.521671:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572587.521675:0:25681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572587.521742:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+38:21272:x1875453495426688:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 383us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572587.521749:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:1.0:1788572587.531380:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.531685:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495426944 00000100:00100000:2.0:1788572587.531696:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495426944 00000100:00100000:2.0:1788572587.531795:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1788572587.531806:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+38:21272:x1875453495426944:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572587.531906:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.531925:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.531937:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572587.532793:0:23657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].2, 88 off8344 00000004:00080000:2.0:1788572587.532807:0:23657:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 808323557884ns, next at 809323555674ns, rc = 0 00000004:00010000:2.0:1788572587.532934:0:23657:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b98296 reply state 0000000020cb455a transno 17179869212 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572587.532964:0:23657:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572587.533188:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+40:21272:x1875453495426944:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1381us (1816us total) trans 17179869212 rc 0/0 00000100:00100000:2.0:1788572587.533196:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00010000:00010000:2.0:1788572587.537064:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.537081:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.537089:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.537095:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572587.537100:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.537107:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.537130:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572587.537133:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572587.537138:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.537143:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c02024 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572587.538464:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.538631:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495427072 00000100:00100000:2.0:1788572587.538642:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495427072 00000100:00100000:2.0:1788572587.538720:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1788572587.538731:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+39:21272:x1875453495427072:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572587.538756:0:25681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572587.538778:0:25681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1183f expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.538852:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 40 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.538867:0:25681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 40 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.538907:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572587.538910:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572587.538913:0:25681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572587.548296:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+40:21272:x1875453495427072:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 9555us (9830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572587.548308:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788572587.551758:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.552150:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495427200 00000100:00100000:1.0:1788572587.552161:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495427200 00000100:00100000:1.0:1788572587.552236:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572587.552246:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2355:x1875453495427200:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788572587.552626:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2355:x1875453495427200:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 380us (875us total) trans 17179869186 rc 0/0 00000100:00100000:1.0:1788572587.552634:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00080000:0.0:1788572587.552705:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572587.555961:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.556579:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495427456 00000100:00100000:1.0:1788572587.556591:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495427456 00000100:00100000:1.0:1788572587.556662:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572587.556674:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf456b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+40:21272:x1875453495427456:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788572587.556925:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf456b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+41:21272:x1875453495427456:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 252us (972us total) trans 17179869213 rc 0/0 00000100:00100000:1.0:1788572587.556933:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572587.560720:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.561138:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495427712 00000100:00100000:1.0:1788572587.561149:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495427712 00000100:00100000:1.0:1788572587.561206:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788572587.561226:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+41:21272:x1875453495427712:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788572587.561812:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+41:21272:x1875453495427712:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 586us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.561821:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1788572587.564808:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.565104:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495427840 00000100:00100000:1.0:1788572587.565115:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495427840 00000100:00100000:1.0:1788572587.565388:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:1.0:1788572587.565399:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+41:21272:x1875453495427840:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572587.565418:0:23656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572587.565438:0:23656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02032 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11846 expref: -99 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.565798:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c02039 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.565829:0:23656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c02039 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.565842:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c02039 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572587.565897:0:23656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572587.565921:0:23656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c02039 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.565949:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c02032 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11846 expref: 43 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.565969:0:23656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c02039 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11846 expref: 42 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.565977:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:0.0:1788572587.565980:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788572587.565983:0:23656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4400, rc 0) 00000100:00100000:0.0:1788572587.566058:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+42:21272:x1875453495427840:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 660us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.566065:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:2.0:1788572587.575633:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.578641:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495427968 00000100:00100000:2.0:1788572587.578655:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495427968 00000100:00100000:2.0:1788572587.578749:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572587.578761:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2356:x1875453495427968:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572587.578779:0:24340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572587.578799:0:24340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1184d expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572587.578844:0:24340:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b73ab, blocks: 0x1 00010000:00010000:2.0:1788572587.578864:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=808s v=(0 0) 00010000:00010000:2.0:1788572587.578868:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572587.578878:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 7 pid: 24340 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.578914:0:24340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 7 pid: 24340 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.578927:0:24340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572587.579000:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:2356:x1875453495427968:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 240us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572587.579008:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788572587.581585:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.581681:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495428224 00000100:00100000:1.0:1788572587.581692:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495428224 00000100:00100000:1.0:1788572587.581751:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788572587.581762:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+42:21272:x1875453495428224:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788572587.582829:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+42:21272:x1875453495428224:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 1061us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.582840:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788572587.592405:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572587.592568:0:24342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495428352 00000100:00100000:3.0:1788572587.592579:0:24342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495428352 00000100:00100000:3.0:1788572587.592645:0:24342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788572587.592656:0:24342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:21272:x1875453495428352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572587.592674:0:24342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572587.592691:0:24342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11854 expref: -99 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.592722:0:24342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.592732:0:24342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572587.592737:0:24342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572587.592743:0:24342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 8 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.592777:0:24342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.592805:0:24342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.592821:0:24342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24342:1875453518464512:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572587.593102:0:24342:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572587.596329:0:24342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24342:1875453518464512:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572587.596368:0:24342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 8 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.596392:0:24342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:3.0:1788572587.596450:0:24342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+8:21272:x1875453495428352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3796us (4054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572587.596460:0:24342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572587.603601:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.603702:0:23644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495428480 00000100:00100000:0.0:1788572587.603713:0:23644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495428480 00010000:00010000:0.0:1788572587.603758:0:23644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572587.603811:0:23644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572587.603836:0:23644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+8:2356:x1875453495428480:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572587.603854:0:23644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572587.603877:0:23644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.603933:0:23644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.603959:0:23644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b62daa/0x977d9e7969c02040 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1184d expref: 8 pid: 24340 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.603978:0:23644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572587.603982:0:23644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572587.603991:0:23644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 7 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.604002:0:23644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 7 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.604039:0:23644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 7 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572587.604053:0:23644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07679b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:23644:1875453518464640:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788572587.604163:0:23644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572587.611461:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.611589:0:24345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495428608 00000100:00100000:2.0:1788572587.611605:0:24345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495428608 00002000:00100000:2.0:1788572587.611663:0:24345:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x62:0x0] (0->255) req@ffff88c075da6680 x1875453495428608/t0(0) o4->bf89ae46-999b-46d3-9a62-08dfe43909d0@192.168.202.2@tcp:248/0 lens 744/0 e 0 to 0 dl 1788572598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788572587.611673:0:24345:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c075da6680 with x1875453495428608 ext(0->255) 00002000:00010000:2.0:1788572587.611679:0:24345:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c075da6680 00000100:00100000:2.0:1788572587.611715:0:24345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788572587.611725:0:24345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+8:2356:x1875453495428608:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788572587.612740:0:24345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+10:2356:x1875453495428608:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 1010us (1287us total) trans 17179869187 rc 0/0 00000100:00100000:2.0:1788572587.612760:0:24345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:2.0:1788572587.612769:0:24345:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x62:0x0] (0->255) req@ffff88c075da6680 x1875453495428608/t17179869187(0) o4->bf89ae46-999b-46d3-9a62-08dfe43909d0@192.168.202.2@tcp:248/0 lens 744/448 e 0 to 0 dl 1788572598 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788572587.612780:0:24345:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c075da6680 with x1875453495428608 ext(0->255) 00002000:00010000:2.0:1788572587.612785:0:24345:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c075da6680 00000100:00100000:0.0:1788572587.613720:0:23644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07679b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:23644:1875453518464640:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788572587.613761:0:23644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572587.613801:0:23644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:2356:x1875453495428480:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 9966us (10211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.613811:0:23644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572587.620160:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.620436:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495428736 00000100:00100000:2.0:1788572587.620445:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495428736 00000100:00100000:2.0:1788572587.620503:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:2.0:1788572587.620514:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+42:21272:x1875453495428736:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788572587.690035:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+42:21272:x1875453495428736:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 69512us (69873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572587.690049:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000001:00080000:0.0:1788572587.691212:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869207 is committed 00000001:00080000:0.0:1788572587.691227:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869213 is committed 00000004:00080000:0.0:1788572587.691243:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788572587.692868:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572587.692916:0:24341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495428864 00000100:00100000:3.0:1788572587.692923:0:24341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495428864 00000100:00100000:3.0:1788572587.692980:0:24341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788572587.692991:0:24341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:2356:x1875453495428864:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788572587.693846:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572587.693869:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518464768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788572587.693997:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572587.694135:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518464768 00000100:00100000:3.0:1788572587.694142:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518464768 00000100:00100000:3.0:1788572587.694188:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572587.694196:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518464768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788572587.694414:0:25273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 0 -> 256 00002000:00010000:3.0:1788572587.694418:0:25273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1788572587 00002000:00010000:3.0:1788572587.694421:0:25273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788572587.694423:0:25273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 1788572587 -> 1788572587 00002000:00010000:3.0:1788572587.694426:0:25273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788572587.694466:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518464768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (469us total) trans 17179869188 rc 0/0 00000100:00100000:3.0:1788572587.694474:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788572587.694677:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c049ac8e00/2, rc 0, transno 17179869188 00000100:00100000:1.0:1788572587.694685:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518464768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788572587.728864:0:24341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+9:2356:x1875453495428864:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 35861us (35988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.728890:0:24341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000001:00080000:1.0:1788572587.729131:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869186 is committed 00000001:00080000:1.0:1788572587.729142:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869187 is committed 00000100:00100000:1.0:1788572587.732900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572587.733043:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495429120 00000100:00100000:3.0:1788572587.733056:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495429120 00000100:00100000:3.0:1788572587.733302:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:3.0:1788572587.733315:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+13:21272:x1875453495429120:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788572587.733378:0:23658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572587.733404:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4400/0x977d9e7969c02039 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11846 expref: 13 pid: 23656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.733423:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:3.0:1788572587.733429:0:23658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572587.733461:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.733474:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.733484:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572587.733702:0:23658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9b53541 reply state 00000000513c75fb transno 17179869214 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.733712:0:23658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572587.733870:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:21272:x1875453495429120:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 556us (988us total) trans 17179869214 rc 0/0 00000100:00100000:3.0:1788572587.733888:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00010000:00010000:3.0:1788572587.737559:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.737577:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.737586:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.737592:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572587.737598:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.737618:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.737635:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:3.0:1788572587.737639:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572587.737644:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.737651:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0204e lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572587.737748:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572587.737891:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495429248 00000100:00100000:2.0:1788572587.737901:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495429248 00000100:00100000:2.0:1788572587.737962:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788572587.737972:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2355:x1875453495429248:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788572587.738170:0:25273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 256 -> 256 00002000:00010000:2.0:1788572587.738174:0:25273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 1788572587 -> 1788572586 00002000:00010000:2.0:1788572587.738177:0:25273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 1788572585 00002000:00010000:2.0:1788572587.738179:0:25273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 1788572587 -> 1788572586 00002000:00010000:2.0:1788572587.738181:0:25273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788572587.738241:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:2355:x1875453495429248:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 269us (495us total) trans 17179869189 rc 0/0 00000100:00100000:2.0:1788572587.738266:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1788572587.744326:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572587.744409:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495429504 00000100:00100000:3.0:1788572587.744419:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495429504 00000100:00100000:3.0:1788572587.744475:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:3.0:1788572587.744485:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+13:21272:x1875453495429504:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788572587.744550:0:23656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.744568:0:23656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 13 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.744579:0:23656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.744623:0:23656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 13 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.744637:0:23656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 13 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.744652:0:23656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23656:1875453518464896:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572587.744826:0:23656:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572587.748831:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.749380:0:23643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495429632 00000100:00100000:1.0:1788572587.749390:0:23643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495429632 00010000:00010000:1.0:1788572587.749430:0:23643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 14 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572587.749521:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788572587.749532:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:2355:x1875453495429632:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572587.749546:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572587.749553:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 14 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.749567:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 14 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.749591:0:23643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:1.0:1788572587.749596:0:23643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.749618:0:23643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.749627:0:23643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.749660:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572587.749723:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:2355:x1875453495429632:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 192us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.749731:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00010000:00010000:3.0:1788572587.750431:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0201d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11838 expref: 13 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.750451:0:23656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23656:1875453518464896:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572587.750476:0:23656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750495:0:23656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750502:0:23656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750530:0:23656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750538:0:23656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750545:0:23656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750550:0:23656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572587.750555:0:23656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750563:0:23656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750574:0:23656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:3.0:1788572587.750577:0:23656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788572587.750581:0:23656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.750588:0:23656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02055 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.750651:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+12:21272:x1875453495429504:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 6167us (6335us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788572587.750665:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:2.0:1788572587.756036:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572587.756331:0:24340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495429760 00000100:00100000:3.0:1788572587.756341:0:24340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495429760 00000100:00100000:3.0:1788572587.756391:0:24340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788572587.756400:0:24340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:2353:x1875453495429760:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788572587.756441:0:24340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.756461:0:24340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 7 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.756470:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572587.756474:0:24340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572587.756479:0:24340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.756511:0:24340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 7 pid: 24342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.756525:0:24340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 7 pid: 24342 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.756540:0:24340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24340:1875453518465024:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572587.756611:0:24340:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572587.759846:0:24340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24340:1875453518465024:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572587.759913:0:24340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572587.761745:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.761853:0:23644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495429888 00000100:00100000:0.0:1788572587.761864:0:23644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495429888 00010000:00010000:0.0:1788572587.761927:0:23644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 8 pid: 24342 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572587.761976:0:23644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788572587.761986:0:23644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a557100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+8:2356:x1875453495429888:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572587.762001:0:23644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572587.762025:0:23644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 8 pid: 24342 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.762040:0:23644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 8 pid: 24342 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.762063:0:23644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca8fdbe1/0x977d9e7969c02047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11854 expref: 8 pid: 24342 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.762093:0:23644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572587.762097:0:23644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572587.763163:0:23644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.763191:0:23644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.763232:0:23644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572587.763319:0:23644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a557100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+7:2356:x1875453495429888:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1332us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.763328:0:23644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00010000:00010000:3.0:1788572587.763450:0:24340:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763460:0:24340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763489:0:24340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763497:0:24340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763506:0:24340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763513:0:24340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024bc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572587.763518:0:24340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763528:0:24340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763541:0:24340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.763562:0:24340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6ff2bd/0x977d9e7969c0205c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.763616:0:24340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2353:x1875453495429760:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 7217us (7591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572587.763624:0:24340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788572587.766755:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572587.767399:0:23657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495430144 00000100:00100000:3.0:1788572587.767410:0:23657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495430144 00000100:00100000:3.0:1788572587.767471:0:23657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:3.0:1788572587.767482:0:23657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+12:21272:x1875453495430144:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788572587.767556:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767574:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767585:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767816:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767827:0:23657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 13 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767835:0:23657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767898:0:23657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 13 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.767912:0:23657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 13 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.767934:0:23657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23657:1875453518465152:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572587.768017:0:23657:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572587.772636:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.772718:0:23643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495430272 00000100:00100000:1.0:1788572587.772728:0:23643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495430272 00010000:00010000:1.0:1788572587.772770:0:23643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 14 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572587.772816:0:23643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572587.772826:0:23643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:2355:x1875453495430272:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572587.772841:0:23643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572587.772849:0:23643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 14 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.772863:0:23643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 14 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.772897:0:23643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:1.0:1788572587.772902:0:23643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.772913:0:23643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.773021:0:23643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.773058:0:23643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572587.773120:0:23643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+14:2355:x1875453495430272:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 294us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.773128:0:23643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00010000:00010000:3.0:1788572587.775507:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0202b lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1183f expref: 13 pid: 25681 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572587.775532:0:23657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23657:1875453518465152:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572587.775560:0:23657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.775571:0:23657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.775577:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572587.776452:0:23657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869215 00000001:00080000:2.0:1788572587.776824:0:23657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869216 00000001:00080000:2.0:1788572587.776871:0:23657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869217 00000100:00100000:2.0:1788572587.776981:0:23657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23657:1875453518465280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788572587.777043:0:23657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572587.777082:0:23657:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c414f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572587.777410:0:23662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518465280 00000100:00100000:1.0:1788572587.777419:0:23662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518465280 00000100:00100000:1.0:1788572587.777502:0:23662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572587.777513:0:23662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23657:x1875453518465280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788572587.777610:0:23662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23657:x1875453518465280:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.777619:0:23662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572587.777682:0:23657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23657:1875453518465280:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788572587.778374:0:23657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869218 00000100:00100000:2.0:1788572587.778439:0:23657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23657:1875453518465408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788572587.778478:0:23657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572587.782978:0:23657:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c4143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572587.783427:0:23663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518465408 00000100:00100000:0.0:1788572587.783437:0:23663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518465408 00000100:00100000:0.0:1788572587.783491:0:23663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788572587.783500:0:23663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23657:x1875453518465408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788572587.784065:0:23663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:23657:x1875453518465408:12345-0@lo:1000:mdt00_001.0 Request processed in 564us (5584us total) trans 17179869190 rc 0/0 00000100:00100000:0.0:1788572587.784075:0:23663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788572587.784228:0:23657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23657:1875453518465408:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788572587.784312:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784323:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784330:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784336:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572587.784341:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784349:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784365:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c0593ef200) 00010000:00010000:2.0:1788572587.784380:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572587.784385:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784393:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c0206a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784431:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784437:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784443:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784448:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572587.784451:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784457:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784465:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:2.0:1788572587.784468:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572587.784476:0:23657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 16 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784487:0:23657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 16 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784496:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 16 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572587.784538:0:23657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4600/0x977d9e7969c01fc2 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11823 expref: 16 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572587.784553:0:23657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23657:1875453518465536:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788572587.784679:0:23657:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c4143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572587.788627:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.789501:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495430400 00000100:00100000:1.0:1788572587.789513:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495430400 00000100:00100000:1.0:1788572587.789571:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788572587.789581:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+17:21271:x1875453495430400:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:1.0:1788572587.789715:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+17:21271:x1875453495430400:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 135us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.789722:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788572587.791808:0:23657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23657:1875453518465536:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788572587.791844:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.791856:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c01fbb lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792065:0:23657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792082:0:23657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792094:0:23657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792121:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792127:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792140:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792146:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a4000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.792150:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792158:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792171:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:0.0:1788572587.792174:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572587.792185:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792191:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c02071 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792202:0:23657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792208:0:23657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792215:0:23657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792225:0:23657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.792229:0:23657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792235:0:23657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792244:0:23657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:0.0:1788572587.792427:0:23657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788572587.792432:0:23657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.792440:0:23657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c02063 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23657 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572587.792831:0:23689:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788572587.792836:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572587.792861:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:1.0:1788572587.792868:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788572587.793169:0:23657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21272:x1875453495430144:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 25685us (26420us total) trans 17179869219 rc 0/0 00000100:00100000:0.0:1788572587.793189:0:23657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000020:00080000:0.0:1788572587.793195:0:23657:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788572587.796544:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.796706:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495430656 00000100:00100000:0.0:1788572587.796715:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495430656 00000100:00100000:0.0:1788572587.796778:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1788572587.796789:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21271:x1875453495430656:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:0.0:1788572587.797244:0:25681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].2, 136 off8464 00000100:00100000:0.0:1788572587.797423:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+16:21271:x1875453495430656:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 622us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.797432:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1788572587.806498:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.806590:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572587.806738:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495430912 00000100:00100000:1.0:1788572587.806747:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495430912 00000100:00100000:1.0:1788572587.806784:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495431168 00000100:00100000:1.0:1788572587.806786:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495431168 00000100:00100000:1.0:1788572587.806805:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572587.806814:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+17:21272:x1875453495430912:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788572587.807803:0:23659:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788572587.807917:0:23659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869220 00010000:00010000:1.0:1788572587.807964:0:23659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.807983:0:23659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.807995:0:23659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.808004:0:23659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.808011:0:23659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.808018:0:23659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572587.808037:0:23659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572587.808209:0:23646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572587.808217:0:23646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.808224:0:23646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572587.808229:0:23646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.808238:0:23646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.808268:0:23646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff88c058eac900) 00010000:00010000:3.0:1788572587.808272:0:23646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572587.808277:0:23646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.808283:0:23646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c02078 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572587.808300:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572587.808302:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572587.808304:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572587.808423:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+19:21272:x1875453495430912:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1606us (1930us total) trans 17179869221 rc 0/0 00000100:00100000:1.0:1788572587.808433:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000020:00080000:1.0:1788572587.808438:0:23659:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788572587.808462:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572587.808472:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+18:21271:x1875453495431168:12345-192.168.202.2@tcp:35:lfs.500 00000100:00100000:1.0:1788572587.808576:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+19:21271:x1875453495431168:12345-192.168.202.2@tcp:35:lfs.500 Request processed in 106us (1985us total) trans 17179869222 rc 0/0 00000100:00100000:1.0:1788572587.808590:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572587.849035:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572587.849165:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495431296 00000100:00100000:0.0:1788572587.849178:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495431296 00000100:00100000:0.0:1788572587.849245:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788572587.849299:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+19:21274:x1875453495431296:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572587.849330:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572587.849352:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c0207f lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1185b expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849430:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849446:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849457:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849471:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849478:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849485:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849747:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c02094 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849756:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c02094 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849770:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c02094 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572587.849800:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00000004:00200000:0.0:1788572587.849803:0:23658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572587.849821:0:23658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c02094 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849833:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c02094 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849841:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849848:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849855:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849861:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a5000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.849865:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849902:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849913:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:0.0:1788572587.849916:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572587.849921:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849937:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5000/0x977d9e7969c02086 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849950:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849956:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849962:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849967:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bf410a5e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572587.849970:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849977:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849983:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff88bf4564e200) 00010000:00010000:0.0:1788572587.849986:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572587.849988:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.849994:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a5e00/0x977d9e7969c0208d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.850021:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4000/0x977d9e7969c0207f lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1185b expref: 21 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.850044:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bf410a4c00/0x977d9e7969c02094 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1185b expref: 20 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572587.850050:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:0.0:1788572587.850053:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572587.850055:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bf410a4c00, rc 0) 00000100:00100000:0.0:1788572587.850124:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21274:x1875453495431296:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 829us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.850133:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00010000:00010000:1.0:1788572588.072441:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572588.843180:0:23689:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788572588.843191:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572588.843229:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:1.0:1788572588.843236:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1788572588.843579:0:23689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23689:1875453518465664:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572588.849992:0:23689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0619c8cc0 going to sleep for 11 seconds 00000040:00080000:3.0:1788572588.853842:0:25831:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788572588.853852:0:25831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572588.853900:0:25831:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788572588.853906:0:25831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1788572588.859856:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572588.859937:0:23689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23689:1875453518465664:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788572588.860237:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495431424 00000100:00100000:2.0:1788572588.860244:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495431424 00000100:00100000:2.0:1788572588.860414:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:2.0:1788572588.860425:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21285:x1875453495431424:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788572588.860455:0:25681:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788572588.860572:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21285:x1875453495431424:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 148us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572588.860579:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:3.0:1788572588.864868:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572588.865202:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495431680 00000100:00100000:2.0:1788572588.865212:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495431680 00000100:00100000:2.0:1788572588.865285:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1788572588.865296:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+20:21285:x1875453495431680:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572588.865327:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572588.865349:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0209b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11862 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572588.865446:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c020a2 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572588.865469:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c020a2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572588.865485:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c020a2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572588.865499:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00010000:00010000:2.0:1788572588.865623:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0209b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11862 expref: 23 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572588.865640:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c020a2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11862 expref: 22 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572588.865648:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:2.0:1788572588.865651:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572588.865655:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572588.865706:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+22:21285:x1875453495431680:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 412us (846us total) trans 17179869223 rc 0/0 00000100:00100000:2.0:1788572588.865713:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00080000:2.0:1788572588.866796:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572588.872460:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572588.872846:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495431936 00000100:00100000:3.0:1788572588.872857:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495431936 00000100:00100000:3.0:1788572588.872927:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1788572588.872937:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+22:21285:x1875453495431936:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788572588.873012:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873029:0:25681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873042:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873511:0:25681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873520:0:25681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873526:0:25681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873532:0:25681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ae00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572588.873536:0:25681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873543:0:25681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873555:0:25681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:3.0:1788572588.873558:0:25681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572588.873573:0:25681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.873580:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c020b0 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572588.873773:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+23:21285:x1875453495431936:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 837us (1321us total) trans 17179869224 rc 0/0 00000100:00100000:3.0:1788572588.873782:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:0.0:1788572588.877659:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572588.877695:0:23659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432192 00000100:00100000:0.0:1788572588.877704:0:23659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432192 00000100:00100000:0.0:1788572588.877769:0:23659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:0.0:1788572588.877779:0:23659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+23:21285:x1875453495432192:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788572588.878021:0:23659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf89ae46-999b-46d3-9a62-08dfe43909d0+24:21285:x1875453495432192:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 242us (367us total) trans 17179869225 rc 0/0 00000100:00100000:0.0:1788572588.878029:0:23659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788572588.883179:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572588.883213:0:23644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432320 00000100:00100000:3.0:1788572588.883223:0:23644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432320 00000100:00100000:3.0:1788572588.883300:0:23644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788572588.883739:0:23644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+24:2353:x1875453495432320:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572588.883757:0:23644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572588.883783:0:23644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c020a2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11862 expref: 24 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572588.883800:0:23644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:3.0:1788572588.883805:0:23644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572588.883988:0:23644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+23:2353:x1875453495432320:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 153us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572588.883998:0:23644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000040:00080000:3.0:1788572588.884385:0:23689:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788572588.884390:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572588.884424:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788572588.884430:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:1.0:1788572589.097801:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572589.161107:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572589.161137:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518465792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572589.161213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572589.161586:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518465792 00000100:00100000:0.0:1788572589.161594:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518465792 00000100:00100000:0.0:1788572589.161661:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572589.161672:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518465792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572589.161694:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788572589.161750:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518465792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.161757:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788572589.161833:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572589.161976:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518465792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572590.120625:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788572590.931832:0:25882:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788572590.931841:0:25882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572590.931883:0:25882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788572590.931888:0:25882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788572590.934842:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.934884:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.934909:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.934928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.934946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.934965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.934987:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572590.935014:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432704 00000100:00100000:0.0:1788572590.935024:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432704 00000100:00100000:0.0:1788572590.935073:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495433216 00000100:00100000:0.0:1788572590.935076:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495433216 00000100:00100000:0.0:1788572590.935089:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432832 00000100:00100000:0.0:1788572590.935092:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432832 00000100:00100000:0.0:1788572590.935104:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495433088 00000100:00100000:0.0:1788572590.935106:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495433088 00000100:00100000:0.0:1788572590.935121:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788572590.935130:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2356:x1875453495432704:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572590.935198:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+6:2356:x1875453495432704:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.935205:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788572590.935224:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788572590.935230:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495433216:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572590.935284:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495433216:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.935291:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788572590.935303:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572590.935309:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2356:x1875453495432832:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572590.935348:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf89ae46-999b-46d3-9a62-08dfe43909d0+5:2356:x1875453495432832:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.935355:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572590.935367:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788572590.935373:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495433088:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572590.935396:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495433088:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.935403:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788572590.935433:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432960 00000100:00100000:0.0:1788572590.935437:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432960 00000100:00100000:0.0:1788572590.935463:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432576 00000100:00100000:0.0:1788572590.935466:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432576 00000100:00100000:0.0:1788572590.935484:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788572590.935490:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495432960:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572590.935516:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96693705-5e29-4404-974e-e904d01a815e+5:2356:x1875453495432960:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.935522:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788572590.935534:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788572590.935540:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+23:2356:x1875453495432576:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572590.935563:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+23:2356:x1875453495432576:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.935570:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00080000:0.0:1788572590.935595:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572590.935600:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572590.935602:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572590.935992:0:23649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495432448 00000100:00100000:3.0:1788572590.935998:0:23649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495432448 00000100:00100000:3.0:1788572590.936038:0:23649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:3.0:1788572590.936046:0:23649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2356:x1875453495432448:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572590.936081:0:23649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f28dd17-6644-45dd-bf11-f8af88abec3c+13:2356:x1875453495432448:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572590.936088:0:23649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:0.0:1788572591.078334:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572591.078409:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495433472 00000100:00100000:2.0:1788572591.078429:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495433472 00000100:00100000:2.0:1788572591.078490:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:2.0:1788572591.078502:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+23:21304:x1875453495433472:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572591.078523:0:23658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572591.078552:0:23658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c020b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11869 expref: -99 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572591.078787:0:23658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c020be lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572591.078802:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c020be lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572591.078815:0:23658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c020be lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572591.078825:0:23658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572591.078945:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c020b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11869 expref: 26 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572591.078982:0:23658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c020be lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11869 expref: 25 pid: 23658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572591.078991:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:2.0:1788572591.078994:0:23658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572591.078997:0:23658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572591.079091:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf89ae46-999b-46d3-9a62-08dfe43909d0+25:21304:x1875453495433472:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 591us (768us total) trans 17179869226 rc 0/0 00000100:00100000:2.0:1788572591.079099:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00010000:00010000:1.0:1788572591.145447:0:23646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572591.720687:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518465920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.720807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572591.720914:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518465920 00000100:00100000:0.0:1788572591.720923:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518465920 00000100:00100000:0.0:1788572591.720979:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788572591.720989:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518465920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.722118:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518466048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.722167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572591.722213:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572591.722221:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518466176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572591.722272:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572591.722299:0:25273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518466048 00000100:00100000:3.0:1788572591.722304:0:25273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518466048 00000100:00100000:3.0:1788572591.722347:0:25273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572591.722353:0:25273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518466048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.722396:0:25273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518466048:12345-0@lo:400:kworker.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572591.722404:0:25273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572591.722426:0:24343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518466176 00000100:00100000:3.0:1788572591.722430:0:24343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518466176 00000100:00100000:3.0:1788572591.722452:0:24343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572591.722474:0:24343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518466176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572591.722502:0:24343:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788572591.722538:0:24343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518466176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572591.722544:0:24343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788572591.722560:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572591.722563:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572591.722599:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518466176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572591.722634:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518466048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.724980:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3220b4e-982e-4e01-8588-718942d18413+19:3297:x1875453518465920:12345-0@lo:400:kworker.0 Request processed in 3984us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.724995:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788572591.725388:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3220b4e-982e-4e01-8588-718942d18413:3297:1875453518465920:0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.727305:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518466304:0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.727385:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.727522:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518466560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.727557:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.727580:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572591.727586:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518466432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.727624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572591.727730:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518466304 00000100:00100000:0.0:1788572591.727739:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518466304 00000100:00100000:0.0:1788572591.727805:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518466560 00000100:00100000:0.0:1788572591.727809:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518466560 00000100:00100000:0.0:1788572591.727833:0:23656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518466432 00000100:00100000:0.0:1788572591.727836:0:23656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518466432 00000100:00100000:0.0:1788572591.727853:0:23656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788572591.727861:0:23656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518466304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.727943:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572591.727960:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518466560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.727997:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518466560:12345-0@lo:400:kworker.0 Request processed in 47us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572591.728005:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572591.728036:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572591.728043:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4779ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518466432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.728071:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4779ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518466432:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572591.728076:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572591.728114:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518466432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.728142:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518466560:0@lo:400:kworker.0 00000100:00080000:1.0:1788572591.731036:0:23652:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572591.736945:0:23656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518466304:12345-0@lo:400:kworker.0 Request processed in 9071us (9546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.737017:0:23656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572591.737306:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4779c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518466304:0@lo:400:kworker.0 00000040:00080000:3.0:1788572591.976933:0:23689:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788572591.977103:0:23689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572591.977143:0:23689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788572591.977162:0:23689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:2.0:1788572592.170234:0:23645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13892 lines, 13892 kept, 0 dropped, 0 bad.