00000001:00100000:1.0F:1789480225.750057:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32666111-a0c9-493f-9593-5072557145d9 00000020:00000080:1.0:1789480225.750074:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d22bb0dc800/32666111-a0c9-493f-9593-5072557145d9 00000001:00100000:1.0:1789480225.750099:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00000020:00000080:1.0:1789480225.750101:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d218785e800/11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00000020:00000080:1.0:1789480225.750119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb0dc800/32666111-a0c9-493f-9593-5072557145d9 for lustre-OST0001 00000020:00000080:1.0:1789480225.750181:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d218785e800/11a5fd0e-73e8-4c23-8b68-dd708fa09a05 for lustre-OST0001 00000020:00000080:1.0:1789480225.750198:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22bb0dc000 for lustre-OST0001 00000020:00000080:1.0:1789480225.750203:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d218785b800 for lustre-OST0001 00010000:00010000:3.0F:1789480225.819060:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1789480226.138552:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552006912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480226.138638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1789480226.139388:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006912 00000100:00100000:2.0:1789480226.139413:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006912 00000100:00100000:2.0:1789480226.139474:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480226.139483:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552006912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480226.139510:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480226.143052:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552006912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3561us (4405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480226.143057:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552006912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480226.143112:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000001:00080000:0.0:1789480226.772644:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934632 is committed 00000001:00080000:0.0:1789480226.772676:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:0.0:1789480226.772692:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d22bd6dbd80 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:0.0:1789480226.772698:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22a49b7200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bd6db840 00000020:00080000:0.0:1789480226.772701:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22a49b7000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2187373c00 00000020:00080000:3.0:1789480226.772867:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:3.0:1789480226.773055:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789480226.843382:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480227.739001:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480227.739011:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480227.739052:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789480227.739059:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789480227.873329:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789480228.254667:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00100000:2.0:1789480228.254689:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32666111-a0c9-493f-9593-5072557145d9 00000020:00000080:2.0:1789480228.254693:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d2187016800/32666111-a0c9-493f-9593-5072557145d9 00000020:00000080:2.0:1789480228.254716:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2187016800/32666111-a0c9-493f-9593-5072557145d9 for lustre-OST0000 00000020:00000080:2.0:1789480228.254756:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2187013800 for lustre-OST0000 00010000:00010000:0.0:1789480228.892937:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480229.758853:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480229.758906:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480229.758944:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480229.758964:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480229.758986:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480229.759065:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857472 00000100:00100000:3.0:1789480229.759086:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857472 00000100:00100000:3.0:1789480229.759144:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:3.0:1789480229.759156:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526857472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480229.759230:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526857472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480229.759237:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:3.0:1789480229.759271:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857728 00000100:00100000:3.0:1789480229.759274:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857728 00000100:00100000:3.0:1789480229.759337:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789480229.759344:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526857728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480229.759373:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526857728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480229.759380:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789480229.759399:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857984 00000100:00100000:3.0:1789480229.759403:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857984 00000100:00100000:3.0:1789480229.759428:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857600 00000100:00100000:3.0:1789480229.759430:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857600 00000100:00100000:3.0:1789480229.759443:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857856 00000100:00100000:3.0:1789480229.759445:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857856 00000100:00100000:3.0:1789480229.759463:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1789480229.759469:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+12:2345:x1876405526857600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480229.759499:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+12:2345:x1876405526857600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480229.759505:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1789480229.759535:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480229.759542:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2345:x1876405526857856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480229.759569:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2345:x1876405526857856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480229.759576:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480229.759587:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1789480229.759594:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:14394:x1876405526857984:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789480229.759646:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:14394:x1876405526857984:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 52us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480229.759652:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00080000:0.0:1789480229.760113:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480229.760119:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480229.779732:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480229.779844:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526858240 00000100:00100000:1.0:1789480229.779854:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526858240 00000100:00100000:1.0:1789480229.779911:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789480229.779921:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c0c9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:14394:x1876405526858240:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789480229.780202:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c0c9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+12:14394:x1876405526858240:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 281us (480us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1789480229.780210:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00010000:00010000:0.0:1789480229.916714:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480230.235058:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552007168:0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235127:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480230.235186:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405552007680:0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235211:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480230.235242:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480230.235247:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552007296:0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235267:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480230.235331:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007168 00000100:00100000:2.0:1789480230.235340:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007168 00000100:00100000:2.0:1789480230.235405:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007296 00000100:00100000:2.0:1789480230.235409:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007296 00000100:00100000:2.0:1789480230.235430:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789480230.235438:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552007168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235491:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552007168:12345-0@lo:400:kworker.0 Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480230.235513:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789480230.235535:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480230.235542:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552007296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235572:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552007296:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480230.235577:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480230.235627:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552007296:0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235638:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552007168:0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235663:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007680 00000100:00100000:2.0:1789480230.235667:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007680 00000100:00100000:2.0:1789480230.235695:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480230.235701:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405552007680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.235752:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405552007680:12345-0@lo:400:kworker.0 Request processed in 50us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480230.235757:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480230.235784:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405552007680:0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236197:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405552007040:0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480230.236274:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552007552:0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480230.236347:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480230.236354:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405552007424:0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236385:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480230.236411:0:16619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007552 00000100:00100000:1.0:1789480230.236416:0:16619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007552 00000100:00100000:1.0:1789480230.236443:0:16619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007424 00000100:00100000:1.0:1789480230.236446:0:16619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007424 00000100:00100000:1.0:1789480230.236460:0:16619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480230.236466:0:16619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405552007552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236502:0:16619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405552007552:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480230.236508:0:16619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480230.236522:0:16619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480230.236527:0:16619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405552007424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236554:0:16619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405552007424:12345-0@lo:400:kworker.0 Request processed in 27us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480230.236560:0:16619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480230.236588:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405552007424:0@lo:400:kworker.0 00000100:00100000:1.0:1789480230.236606:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552007552:0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.237088:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007040 00000100:00100000:2.0:1789480230.237094:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007040 00000100:00100000:2.0:1789480230.237134:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789480230.237140:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d229c543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3299:x1876405552007040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480230.237180:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d229c543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3299:x1876405552007040:12345-0@lo:400:kworker.0 Request processed in 41us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480230.237187:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789480230.237469:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405552007040:0@lo:400:kworker.0 00000100:00080000:0.0:1789480230.237811:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480230.237818:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480230.237820:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480230.238818:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480230.238845:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552007808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480230.238894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480230.238993:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007808 00000100:00100000:3.0:1789480230.239000:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007808 00000100:00100000:3.0:1789480230.239048:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789480230.239057:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552007808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480230.239085:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480230.239136:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552007808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480230.239142:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789480230.240084:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552007808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789480230.943875:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480231.258851:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480231.258879:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552007936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480231.258965:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.259170:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552007936 00000100:00100000:2.0:1789480231.259180:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552007936 00000100:00100000:2.0:1789480231.259249:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789480231.259259:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552007936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480231.259348:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480231.259633:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552007936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 375us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.259640:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789480231.259734:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552007936:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789480231.815838:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1789480231.815864:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:3.0:1789480231.815904:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:3.0:1789480231.815916:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:3.0:1789480231.974701:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480232.988957:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480234.011059:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480234.865179:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480234.865224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480234.865267:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480234.865321:0:16619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526858496 00000100:00100000:1.0:1789480234.865349:0:16619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526858496 00000100:00100000:1.0:1789480234.865424:0:16619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526858752 00000100:00100000:1.0:1789480234.865428:0:16619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526858752 00000100:00100000:1.0:1789480234.865457:0:16619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789480234.865468:0:16619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2346:x1876405526858496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480234.865583:0:16619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2346:x1876405526858496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.865591:0:16619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789480234.865613:0:16619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789480234.865620:0:16619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32666111-a0c9-493f-9593-5072557145d9+6:2346:x1876405526858752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480234.865647:0:16619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32666111-a0c9-493f-9593-5072557145d9+6:2346:x1876405526858752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.865654:0:16619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789480234.866223:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480234.866331:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526858624 00000100:00100000:3.0:1789480234.866338:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526858624 00000100:00100000:3.0:1789480234.866389:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1789480234.866398:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2346:x1876405526858624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480234.866442:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2346:x1876405526858624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480234.866449:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789480234.866573:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526858368 00000100:00100000:0.0:1789480234.866578:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526858368 00000100:00100000:0.0:1789480234.866621:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:0.0:1789480234.866630:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2346:x1876405526858368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480234.866689:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2346:x1876405526858368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 60us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.866697:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00080000:0.0:1789480234.866745:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480234.866752:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480235.036134:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480235.355323:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552008064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480235.355417:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480235.355700:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008064 00000100:00100000:1.0:1789480235.355711:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008064 00000100:00100000:1.0:1789480235.355789:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789480235.355801:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552008064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480235.355854:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480235.355908:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552008064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480235.355916:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789480235.356133:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480235.356189:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552008064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480235.356564:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552008320:0@lo:400:kworker.0 00000100:00100000:3.0:1789480235.356608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480235.356652:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789480235.356658:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552008192:0@lo:400:kworker.0 00000100:00100000:3.0:1789480235.356684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480235.356715:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552008704:0@lo:400:kworker.0 00000100:00100000:3.0:1789480235.356739:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480235.360521:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552008448:0@lo:400:kworker.0 00000100:00100000:0.0:1789480235.360631:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480235.360703:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480235.360712:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552008576:0@lo:400:kworker.0 00000100:00100000:0.0:1789480235.360740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480235.360793:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008704 00000100:00100000:0.0:1789480235.360805:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008704 00000100:00100000:0.0:1789480235.360869:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008448 00000100:00100000:0.0:1789480235.360872:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008448 00000100:00100000:0.0:1789480235.360886:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008576 00000100:00100000:0.0:1789480235.360888:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008576 00000100:00100000:0.0:1789480235.360905:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789480235.360915:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552008704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480235.360988:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552008704:12345-0@lo:400:kworker.0 Request processed in 73us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480235.360996:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789480235.361016:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789480235.361042:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552008448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480235.361077:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552008448:12345-0@lo:400:kworker.0 Request processed in 36us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480235.361084:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789480235.361096:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789480235.361102:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552008576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480235.361130:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552008576:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480235.361136:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789480235.361466:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552008704:0@lo:400:kworker.0 00000100:00080000:0.0:1789480235.361496:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480235.361519:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552008576:0@lo:400:kworker.0 00000100:00100000:0.0:1789480235.361529:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552008448:0@lo:400:kworker.0 00000100:00100000:1.0:1789480235.362240:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008320 00000100:00100000:1.0:1789480235.362250:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008320 00000100:00100000:1.0:1789480235.362344:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789480235.362353:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552008320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480235.362453:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552008320:12345-0@lo:400:kworker.0 Request processed in 101us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480235.362460:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789480235.362489:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008192 00000100:00100000:1.0:1789480235.362493:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008192 00000100:00100000:1.0:1789480235.362522:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789480235.362529:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405552008192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480235.362565:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405552008192:12345-0@lo:400:kworker.0 Request processed in 37us (5879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480235.362572:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789480235.362776:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552008192:0@lo:400:kworker.0 00000100:00100000:1.0:1789480235.362794:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552008320:0@lo:400:kworker.0 00000100:00080000:0.0:1789480235.362841:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789480236.059574:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480236.378526:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552008832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480236.378624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480236.380483:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008832 00000100:00100000:2.0:1789480236.380498:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008832 00000100:00100000:2.0:1789480236.380576:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480236.380589:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552008832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480236.380646:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480236.386569:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552008832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5971us (7934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.386588:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789480236.388641:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552008832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789480237.083576:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480237.985583:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480237.985596:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480237.985684:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789480237.985691:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789480238.108925:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480239.130806:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480239.988352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480239.988474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480239.988525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480239.988570:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480239.988623:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859008 00000100:00100000:0.0:1789480239.988633:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859008 00000100:00100000:0.0:1789480239.988692:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859264 00000100:00100000:0.0:1789480239.988695:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859264 00000100:00100000:0.0:1789480239.988738:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789480239.988748:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2345:x1876405526859008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480239.988829:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2345:x1876405526859008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480239.988837:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789480239.988855:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789480239.988861:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2345:x1876405526859264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480239.988885:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2345:x1876405526859264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480239.988891:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00080000:0.0:1789480239.988906:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480239.990849:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859136 00000100:00100000:3.0:1789480239.990862:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859136 00000100:00100000:1.0:1789480239.990872:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526858880 00000100:00100000:1.0:1789480239.990876:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526858880 00000100:00100000:3.0:1789480239.990941:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1789480239.990952:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526859136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480239.990978:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1789480239.990985:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526858880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480239.991004:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526859136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 55us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480239.991007:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526858880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480239.991012:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1789480239.991013:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00080000:0.0:1789480239.991323:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789480240.155804:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480240.475440:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552008960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480240.475517:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480240.475745:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552009344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480240.475779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480240.475802:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480240.475808:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552009216:0@lo:400:kworker.0 00000100:00100000:0.0:1789480240.475831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480240.475864:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009344 00000100:00100000:0.0:1789480240.475872:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009344 00000100:00100000:0.0:1789480240.475937:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789480240.475947:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552009344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480240.475998:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552009344:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480240.476015:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789480240.476062:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552009344:0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477001:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552009472:0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477045:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480240.477085:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789480240.477092:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552009088:0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480240.477146:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552009600:0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480240.477220:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009472 00000100:00100000:2.0:1789480240.477226:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009472 00000100:00100000:2.0:1789480240.477270:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009600 00000100:00100000:2.0:1789480240.477273:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009600 00000100:00100000:2.0:1789480240.477321:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789480240.477327:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552009472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477364:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552009472:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480240.477370:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789480240.477387:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789480240.477392:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552009600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477412:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552009600:12345-0@lo:400:kworker.0 Request processed in 20us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480240.477417:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789480240.477432:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480240.477450:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552009600:0@lo:400:kworker.0 00000100:00100000:2.0:1789480240.477459:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552009472:0@lo:400:kworker.0 00000100:00100000:1.0:1789480240.477681:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552008960 00000100:00100000:1.0:1789480240.477691:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552008960 00000100:00100000:1.0:1789480240.477743:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789480240.477750:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552008960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480240.477780:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480240.477823:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552008960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480240.477829:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789480240.477853:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009216 00000100:00100000:1.0:1789480240.477855:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009216 00000100:00100000:1.0:1789480240.477888:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480240.477894:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552009216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480240.477927:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552009216:12345-0@lo:400:kworker.0 Request processed in 34us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480240.477933:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480240.477947:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009088 00000100:00100000:1.0:1789480240.477950:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009088 00000100:00100000:1.0:1789480240.477969:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789480240.477974:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3298:x1876405552009088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480240.477997:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3298:x1876405552009088:12345-0@lo:400:kworker.0 Request processed in 23us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480240.478002:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789480240.478042:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552009216:0@lo:400:kworker.0 00000100:00100000:1.0:1789480240.478064:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552009088:0@lo:400:kworker.0 00000100:00100000:1.0:1789480240.478081:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552008960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789480240.479173:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480240.479179:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789480241.179527:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480241.415725:0:17272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:50:39 (1789480239) 00000100:00100000:1.0:1789480241.502343:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480241.502363:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552009728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480241.502429:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480241.502490:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009728 00000100:00100000:1.0:1789480241.502498:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009728 00000100:00100000:1.0:1789480241.502551:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789480241.502561:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552009728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480241.502608:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480241.502663:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552009728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480241.502670:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789480241.502932:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552009728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480242.202467:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480243.229905:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480244.250555:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480245.104627:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.104673:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.104709:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.104749:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.104782:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859520 00000100:00100000:3.0:1789480245.104792:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859520 00000100:00100000:3.0:1789480245.104849:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859776 00000100:00100000:3.0:1789480245.104853:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859776 00000100:00100000:3.0:1789480245.104890:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1789480245.104901:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2345:x1876405526859520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480245.104978:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2345:x1876405526859520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.104986:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1789480245.105004:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1789480245.105012:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:2345:x1876405526859776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480245.105035:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:2345:x1876405526859776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.105042:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00080000:3.0:1789480245.105057:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480245.105462:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859392 00000100:00100000:1.0:1789480245.105468:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859392 00000100:00100000:1.0:1789480245.105516:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:1.0:1789480245.105524:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526859392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480245.105563:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526859392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.105570:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:2.0:1789480245.105986:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859648 00000100:00100000:2.0:1789480245.105992:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859648 00000100:00100000:2.0:1789480245.106047:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789480245.106055:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526859648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480245.106108:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526859648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480245.106130:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00080000:0.0:1789480245.106213:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480245.274678:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480245.595231:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552009984:0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480245.595414:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552010496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480245.595469:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480245.595475:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552010112:0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595530:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480245.595570:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009984 00000100:00100000:3.0:1789480245.595577:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009984 00000100:00100000:3.0:1789480245.595641:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010112 00000100:00100000:3.0:1789480245.595644:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010112 00000100:00100000:3.0:1789480245.595667:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789480245.595676:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552009984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595730:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552009984:12345-0@lo:400:kworker.0 Request processed in 54us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.595737:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789480245.595755:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789480245.595762:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552010112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595792:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552010112:12345-0@lo:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.595798:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789480245.595819:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010496 00000100:00100000:3.0:1789480245.595823:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010496 00000100:00100000:3.0:1789480245.595850:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789480245.595856:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552010496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595887:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552010496:12345-0@lo:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.595893:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789480245.595935:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552010112:0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595946:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552009984:0@lo:400:kworker.0 00000100:00100000:3.0:1789480245.595954:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552010496:0@lo:400:kworker.0 00000100:00080000:0.0:1789480245.596062:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480245.596068:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480245.596070:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480245.597904:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552010240:0@lo:400:kworker.0 00000100:00100000:2.0:1789480245.597976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480245.598024:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789480245.598031:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552009856:0@lo:400:kworker.0 00000100:00100000:2.0:1789480245.598061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480245.598104:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405552010368:0@lo:400:kworker.0 00000100:00100000:2.0:1789480245.598126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.598223:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552009856 00000100:00100000:0.0:1789480245.598231:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552009856 00000100:00100000:0.0:1789480245.598314:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789480245.598322:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3300:x1876405552009856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480245.598373:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3300:x1876405552009856:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.598380:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789480245.598409:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010240 00000100:00100000:0.0:1789480245.598412:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010240 00000100:00100000:0.0:1789480245.598431:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010368 00000100:00100000:0.0:1789480245.598433:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010368 00000100:00100000:0.0:1789480245.598457:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789480245.598462:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552010240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480245.598502:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552010240:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.598508:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789480245.598519:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480245.598524:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405552010368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480245.598548:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405552010368:12345-0@lo:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.598569:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789480245.598583:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480245.598609:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552009856:0@lo:400:kworker.0 00000100:00100000:0.0:1789480245.598621:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405552010368:0@lo:400:kworker.0 00000100:00100000:0.0:1789480245.598628:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552010240:0@lo:400:kworker.0 00000100:00100000:1.0:1789480245.598907:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480245.598917:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552010624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480245.598951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.599046:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010624 00000100:00100000:0.0:1789480245.599050:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010624 00000100:00100000:0.0:1789480245.599085:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480245.599091:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552010624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480245.599117:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480245.599162:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552010624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.599168:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789480245.599269:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552010624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480245.911062:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.911123:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.911162:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480245.911445:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526859904 00000100:00100000:1.0:1789480245.911455:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526859904 00000100:00100000:1.0:1789480245.911513:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526860032 00000100:00100000:1.0:1789480245.911529:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526860032 00000100:00100000:1.0:1789480245.911546:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526860160 00000100:00100000:1.0:1789480245.911549:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526860160 00000100:00100000:1.0:1789480245.911565:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789480245.911574:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4b55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+15:2348:x1876405526859904:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480245.911589:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480245.911608:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39d800/0xbb972366037fe81f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3552 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.911627:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480245.911692:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4b55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+14:2348:x1876405526859904:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 118us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.911699:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789480245.911745:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789480245.911753:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2348:x1876405526860032:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480245.911760:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480245.911769:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4200/0xbb972366037fe826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f357c expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.911779:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480245.911797:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:2348:x1876405526860032:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 45us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.911803:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789480245.911815:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789480245.911820:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:2348:x1876405526860160:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480245.911827:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480245.911835:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe8c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f361d expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.911851:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480245.911870:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:2348:x1876405526860160:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 49us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.911876:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789480245.922632:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480245.922818:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526860416 00000100:00100000:3.0:1789480245.922828:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526860416 00000100:00100000:3.0:1789480245.922887:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789480245.922896:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2344:x1876405526860416:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:3.0:1789480245.922937:0:15010:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe83b 00000020:00010000:3.0:1789480245.922945:0:15010:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d22aea57000: total 0 00000100:00080000:3.0:1789480245.922951:0:15010:0:(import.c:65:import_set_state_nolock()) ffff8d22aea55000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480245.923001:0:15010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1789480245.923680:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+4:2344:x1876405526860416:12345-192.168.204.54@tcp:9:umount.0 Request processed in 782us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.923689:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000020:00010000:0.0:1789480245.923782:0:14314:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d22aea57000: total 0 00010000:00010000:0.0:1789480245.923786:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480245.923816:0:14314:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d22aea57000, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1789480245.923849:0:14314:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789480245.923853:0:14314:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789480245.923877:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c9aee52/0xbb972366037feb83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36f6 expref: 3 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.923900:0:14314:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d22aea57000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789480245.923910:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480245.923912:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480245.923913:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480245.933037:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480245.933156:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526861312 00000100:00100000:1.0:1789480245.933165:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526861312 00000100:00100000:1.0:1789480245.933243:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1789480245.933254:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:2344:x1876405526861312:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1789480245.933323:0:14328:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe834 00000020:00010000:1.0:1789480245.933339:0:14328:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d218785a800: total 0 00000100:00080000:1.0:1789480245.933344:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8d2187012000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480245.933373:0:14328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000020:00010000:2.0:1789480245.933418:0:14315:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d218785a800: total 0 00010000:00010000:2.0:1789480245.933458:0:14315:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d218785a800, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1789480245.933500:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d22837b7900) 00010000:00010000:2.0:1789480245.933504:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480245.933512:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f362b expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.933537:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:2.0:1789480245.933540:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480245.933543:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe937 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3639 expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.933557:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:2.0:1789480245.933559:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480245.933563:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037feb2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36d3 expref: 8 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.933598:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d22837b7800) 00010000:00010000:2.0:1789480245.933600:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480245.933604:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4c00/0xbb972366037fe8e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3624 expref: 8 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.933618:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:2.0:1789480245.933621:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789480245.933624:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fe9bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3663 expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.933638:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:2.0:1789480245.933640:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480245.933644:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 6 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.933657:0:14315:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d218785a800, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1789480245.933669:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480245.933671:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480245.933673:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480245.933787:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+3:2344:x1876405526861312:12345-192.168.204.54@tcp:39:umount.0 Request processed in 534us (760us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1789480245.933794:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:0.0:1789480246.299265:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480246.619463:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480246.619499:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552010752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480246.619595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.619836:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010752 00000100:00100000:1.0:1789480246.619846:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010752 00000100:00100000:1.0:1789480246.619906:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480246.619916:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552010752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480246.619954:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480246.620018:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552010752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.620026:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789480246.620187:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552010752:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789480247.194424:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789480247.194434:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480247.194502:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789480247.194509:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00100000:0.0:1789480247.201214:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00000001:00080000:0.0:1789480247.201234:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:0.0:1789480247.201240:0:5852:0:(genops.c:885:class_export_put()) final put ffff8d218785a800/11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00000020:00000080:3.0:1789480247.201395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d218785a800/11a5fd0e-73e8-4c23-8b68-dd708fa09a05 for lustre-MDT0000 00000020:00000080:3.0:1789480247.201472:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2187012000 for lustre-MDT0000 00010000:00010000:2.0:1789480247.322612:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480248.038780:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480248.038826:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480248.038868:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480248.039015:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526861440 00000100:00100000:0.0:1789480248.039037:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526861440 00000100:00100000:0.0:1789480248.039082:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526861568 00000100:00100000:0.0:1789480248.039085:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526861568 00000100:00100000:0.0:1789480248.039095:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526861696 00000100:00100000:0.0:1789480248.039097:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526861696 00000100:00100000:0.0:1789480248.039111:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480248.039121:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:2345:x1876405526861440:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480248.039136:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480248.039156:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39c600/0xbb972366037fe857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35b4 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.039174:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480248.039234:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:2345:x1876405526861440:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 114us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.039241:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480248.039259:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480248.039265:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:2345:x1876405526861568:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480248.039272:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480248.039321:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe85e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35de expref: 10 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.039332:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480248.039353:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+9:2345:x1876405526861568:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 88us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.039375:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480248.039389:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480248.039396:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:2346:x1876405526861696:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480248.039404:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480248.039414:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2187646200/0xbb972366037fe8c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3616 expref: 8 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.039423:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480248.039452:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+7:2346:x1876405526861696:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 46us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.039459:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1789480248.057525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480248.057846:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526861952 00000100:00100000:3.0:1789480248.057861:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526861952 00000100:00100000:3.0:1789480248.057974:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1789480248.057987:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2344:x1876405526861952:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:3.0:1789480248.058050:0:14327:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe86c 00000020:00010000:3.0:1789480248.058059:0:14327:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d22aea52000: total 0 00000100:00080000:3.0:1789480248.058065:0:14327:0:(import.c:65:import_set_state_nolock()) ffff8d22aea57800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480248.058097:0:14327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1789480248.058577:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+5:2344:x1876405526861952:12345-192.168.204.54@tcp:39:umount.0 Request processed in 590us (1071us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1789480248.058585:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000020:00010000:2.0:1789480248.058821:0:14314:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d22aea52000: total 0 00010000:00010000:2.0:1789480248.058827:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480248.058868:0:14314:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d22aea52000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789480248.058905:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:2.0:1789480248.058909:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480248.058918:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3640 expref: 4 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.058944:0:14314:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d22aea52000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789480248.058954:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480248.058956:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480248.058957:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480248.059257:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480248.103752:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480248.104082:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862208 00000100:00100000:3.0:1789480248.104093:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862208 00000100:00100000:3.0:1789480248.104150:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1789480248.104161:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+7:2344:x1876405526862208:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:3.0:1789480248.104211:0:14320:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe811 00000020:00010000:3.0:1789480248.104220:0:14320:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2185477800: total 0 00000100:00080000:3.0:1789480248.104224:0:14320:0:(import.c:65:import_set_state_nolock()) ffff8d2185475800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789480248.104318:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+3:2344:x1876405526862208:12345-192.168.204.54@tcp:251:umount.0 Request processed in 159us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480248.104327:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000020:00010000:1.0:1789480248.104503:0:14315:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2185477800: total 0 00010000:00010000:1.0:1789480248.104549:0:14315:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2185477800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789480248.104599:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f354b expref: 2 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.104624:0:14315:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2185477800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789480248.104635:0:14315:0:(genops.c:885:class_export_put()) final put ffff8d2185477800/2e88bdc8-7812-42b9-968b-c1d53a5bbc1d 00010000:00010000:1.0:1789480248.104652:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480248.104654:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480248.104656:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789480248.109946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2185477800/2e88bdc8-7812-42b9-968b-c1d53a5bbc1d for MGS 00000020:00000080:3.0:1789480248.111254:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2185475800 for MGS 00010000:00010000:2.0:1789480248.346542:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789480248.753631:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00000020:00000080:2.0:1789480248.753641:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d22aea57000/11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00000020:00000080:3.0:1789480248.753711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22aea57000/11a5fd0e-73e8-4c23-8b68-dd708fa09a05 for lustre-OST0000 00000020:00000080:3.0:1789480248.753764:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22aea55000 for lustre-OST0000 00010000:00010000:2.0:1789480249.376527:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480250.422898:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789480250.450207:0:17470:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789480250.486789:0:17470:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789480250.486858:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.486878:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.486888:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.486897:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.486915:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789480250.486921:0:17470:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789480250.486965:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480250.486971:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789480250.486991:0:17470:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789480250.487025:0:17470:0:(import.c:65:import_set_state_nolock()) ffff8d2286ffa000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789480250.487266:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480250.487276:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480250.487371:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405552010880:0@lo:39:umount.0 00000100:00100000:0.0:1789480250.487469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480250.487809:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480250.487814:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.487825:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480250.487843:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480250.487850:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480250.487852:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789480250.487855:0:14315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789480250.487890:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.487897:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480250.487933:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.487941:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.487955:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480250.487957:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480250.487959:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480250.487972:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480250.487994:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552011008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480250.488036:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480250.488094:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011008 00000100:00100000:2.0:1789480250.488103:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011008 00000100:00100000:2.0:1789480250.488163:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480250.488174:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3300:x1876405552011008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480250.488189:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480250.488206:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22baffe800/0xbb972366037fe547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe540 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.488227:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480250.488266:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:3300:x1876405552011008:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480250.488274:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480250.488346:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552011008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480250.489191:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552010880 00000100:00100000:1.0:1789480250.489200:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552010880 00000100:00100000:1.0:1789480250.489251:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789480250.489259:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876405552010880:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789480250.489310:0:14328:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe571 00000100:00080000:1.0:1789480250.489323:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8d2283304000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789480250.489424:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1876405552010880:12345-0@lo:39:umount.0 Request processed in 165us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480250.489431:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00000080:1.0:1789480250.489440:0:14328:0:(genops.c:885:class_export_put()) final put ffff8d2283301800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789480250.489471:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283301800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789480250.489525:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2283304000 for lustre-MDT0000 00000100:00080000:1.0:1789480250.489563:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2286ffa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789480250.489573:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405552010880:0@lo:39:umount.0 00010000:00010000:1.0:1789480250.489600:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480250.490240:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480250.490246:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789480250.490251:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789480250.491716:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491741:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491750:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491759:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491778:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480250.491784:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491790:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491797:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491822:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491837:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789480250.491844:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491852:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491859:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491866:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491874:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789480250.491879:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491886:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491893:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491899:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.491917:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789480250.491920:0:17470:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789480250.491954:0:17470:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789480250.491959:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789480250.491964:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480250.491971:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1789480250.491995:0:17470:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2187010000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480250.492002:0:17470:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d229c50d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480250.492010:0:17470:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d22aea52000 32666111-a0c9-493f-9593-5072557145d9 192.168.204.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1789480250.492016:0:17470:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d22bcb03380) has exports, disconnecting them 00000020:00080000:0.0:1789480250.492022:0:17470:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2187010000), last request at 1789480245 00000020:00000080:0.0:1789480250.492031:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe72a 00000100:00080000:0.0:1789480250.492053:0:17470:0:(import.c:65:import_set_state_nolock()) ffff8d2187014000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789480250.492112:0:17470:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2187010000): rc 0 00000020:00000080:0.0:1789480250.492115:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2187010000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789480250.492130:0:17470:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d229c50d000), last request at 1789480245 00000020:00000080:0.0:1789480250.492134:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe5f6 00000100:00080000:0.0:1789480250.492139:0:17470:0:(import.c:65:import_set_state_nolock()) ffff8d229c50e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789480250.492146:0:17470:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d229c50d000): rc 0 00000020:00000080:0.0:1789480250.492148:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d229c50d000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789480250.492155:0:17470:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa287030bbae0 00000100:00080000:0.0:1789480250.492179:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789480250.492183:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:0.0:1789480250.492197:0:17470:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789480250.492271:0:17470:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789480250.492325:0:17470:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789480250.492352:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789480250.492355:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1789480250.492365:0:17470:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789480250.492463:0:17470:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789480250.492474:0:17470:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789480250.492514:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d22bcb03380) has no exports 00000020:00000080:1.0:1789480250.492601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2187010000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789480250.492659:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789480250.492691:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2187014000 for lustre-MDT0000 00000020:00000080:1.0:1789480250.492696:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d229c50e800 for lustre-MDT0000 00000100:00100000:1.0:1789480250.492726:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552011136:0@lo:9:umount.0 00000100:00100000:1.0:1789480250.492826:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480250.492872:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552011264:0@lo:9:umount.0 00000100:00100000:1.0:1789480250.492893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480250.492938:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011136 00000100:00100000:1.0:1789480250.492948:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011136 00000100:00100000:1.0:1789480250.493007:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011264 00000100:00100000:1.0:1789480250.493010:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011264 00000100:00100000:1.0:1789480250.493035:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480250.493045:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1876405552011136:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789480250.493074:0:15011:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe612 00000100:00080000:1.0:1789480250.493083:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8d229c508800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480250.493112:0:15011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1789480250.493573:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3297:x1876405552011136:12345-0@lo:9:umount.0 Request processed in 528us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480250.493582:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480250.493603:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789480250.493610:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1876405552011264:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789480250.493626:0:15011:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe746 00000100:00080000:1.0:1789480250.493632:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8d218785f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480250.493649:0:15011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1789480250.493851:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3297:x1876405552011264:12345-0@lo:9:umount.0 Request processed in 241us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480250.493857:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789480250.493886:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480250.493891:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480250.493935:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789480250.493950:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789480250.493952:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480250.493968:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552011136:0@lo:9:umount.0 00000100:00080000:1.0:1789480250.493984:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789480250.493995:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789480250.493997:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480250.493999:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552011264:0@lo:9:umount.0 00010000:00010000:1.0:1789480250.494040:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789480250.494048:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480250.494058:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480250.494062:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480250.494073:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480250.494080:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480250.494087:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789480250.494090:0:14314:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789480250.494093:0:14314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1789480250.494130:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480250.494136:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480250.494159:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480250.494166:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480250.494200:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552011392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480250.494251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480250.494333:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011392 00000100:00100000:1.0:1789480250.494338:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011392 00000100:00100000:1.0:1789480250.494377:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480250.494385:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:3298:x1876405552011392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480250.494408:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480250.494427:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7400/0xbb972366037fe4ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe4a6 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480250.494440:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480250.494528:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789480250.494536:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.494543:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480250.494546:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.494555:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480250.494562:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480250.494568:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480250.494571:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789480250.494574:0:14315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789480250.494591:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.494597:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789480250.495253:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:3298:x1876405552011392:12345-0@lo:103:ldlm_bl.0 Request processed in 865us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480250.495262:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789480250.495354:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495381:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495413:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480250.495418:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495424:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39de00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480250.495428:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495436:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480250.495443:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480250.495448:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789480250.495450:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789480250.495452:0:14315:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789480250.495477:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495483:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480250.495512:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495518:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495537:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480250.495540:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495546:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480250.495549:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495557:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480250.495563:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480250.495569:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480250.495572:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789480250.495574:0:14315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789480250.495589:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495596:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480250.495602:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495609:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480250.495621:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480250.495623:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480250.495630:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480250.495652:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552011776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480250.495706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480250.495739:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480250.495746:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552011648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480250.495767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480250.497494:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011776 00000100:00100000:0.0:1789480250.497508:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011776 00000100:00100000:0.0:1789480250.497559:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011648 00000100:00100000:0.0:1789480250.497562:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011648 00000100:00100000:0.0:1789480250.497581:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480250.497592:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:3301:x1876405552011776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480250.497610:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480250.497639:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bafff000/0xbb972366037fe49f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe498 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.497661:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480250.497740:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:3301:x1876405552011776:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480250.497747:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480250.497764:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480250.497769:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3301:x1876405552011648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480250.497778:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480250.497786:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe8b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe8b2 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480250.497795:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480250.497812:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:3301:x1876405552011648:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480250.497833:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789480250.497851:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480250.497855:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480250.497857:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480250.499946:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552011648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480250.499964:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552011776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480250.500194:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552011392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480250.500211:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480250.500224:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552011520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480250.500336:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480250.500419:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011520 00000100:00100000:1.0:1789480250.500428:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011520 00000100:00100000:1.0:1789480250.500489:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789480250.500499:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:3298:x1876405552011520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480250.500515:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480250.500538:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39d600/0xbb972366037fe73f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe738 expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480250.500586:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480250.500697:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:3298:x1876405552011520:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480250.500705:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789480250.500733:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552011520:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789480250.508865:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d22bcb03380) has no exports 00000020:00000080:2.0:1789480250.608477:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe4f3 00000020:00000080:2.0:1789480250.608494:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22bfd4e000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789480250.608573:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789480250.608913:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bfd4e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789480250.609035:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480250.609046:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480250.609051:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d22bd6b4d40) has no exports 00000020:00000080:0.0:1789480250.612888:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe4ec 00000020:00000080:0.0:1789480250.612907:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22925b5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480250.613182:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22925b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480250.613275:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480250.613457:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789480250.613461:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22925b4800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789480250.613464:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22925b4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789480250.613470:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1789480250.715831:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405552012032:0@lo:400:kworker.0 00000100:00100000:1.0:1789480250.716053:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480250.716154:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480250.716164:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552011904:0@lo:400:kworker.0 00000100:00100000:1.0:1789480250.716188:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480250.716314:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552012032 00000100:00100000:3.0:1789480250.716327:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552012032 00000100:00100000:0.0:1789480250.716332:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552011904 00000100:00100000:0.0:1789480250.716345:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552011904 00000100:00100000:3.0:1789480250.716377:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789480250.716388:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876405552012032:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789480250.716416:0:14327:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789480250.716416:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789480250.716433:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876405552011904:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789480250.716442:0:14326:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789480250.716486:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876405552012032:12345-0@lo:400:kworker.0 Request processed in 97us (432us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789480250.716495:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789480250.716522:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876405552011904:12345-0@lo:400:kworker.0 Request processed in 88us (330us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789480250.716534:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789480250.716660:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789480250.716666:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d22bb590000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789480250.716671:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789480250.757510:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d22bb590000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480250.757525:0:3299:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1789480250.757541:0:3299:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d22bb590000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480250.757651:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd785180 x1876405552012160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480250.757684:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552011904:0@lo:400:kworker.0 00000100:00080000:1.0:1789480250.757717:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789480250.757722:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d2185475000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789480250.757726:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789480250.757742:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405552012160:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1789480250.757749:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d2185475000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480250.757760:0:3299:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1789480250.757768:0:3299:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2185475000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480250.757790:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd784380 x1876405552012288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480250.757803:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405552012032:0@lo:400:kworker.0 00000100:00100000:2.0:1789480250.757856:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480250.757953:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405552012288:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789480250.758082:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552012160 00000100:00100000:1.0:1789480250.758093:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552012160 00000100:00100000:2.0:1789480250.758193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480250.760239:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552012288 00000100:00100000:1.0:1789480250.760258:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552012288 00000100:00100000:1.0:1789480250.760341:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789480250.760352:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876405552012160:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789480250.760378:0:14327:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789480250.761247:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789480250.761257:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405552012288:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789480250.763411:0:14326:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789480250.763568:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405552012288:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2304us (5580us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789480250.763584:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789480250.763814:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2185475000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480250.763822:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789480250.763827:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405552012288:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789480250.768447:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876405552012160:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 8082us (10578us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789480250.768469:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789480250.768795:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb590000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480250.768803:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789480250.768808:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405552012160:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:1.0:1789480251.360612:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480251.360625:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d218785b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480251.360670:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d218785b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789480251.360732:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d218785f000 for lustre-OST0001 00010000:00010000:2.0:1789480251.418755:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789480252.327056:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32666111-a0c9-493f-9593-5072557145d9 00000001:00080000:2.0:1789480252.327085:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1789480252.327092:0:5852:0:(genops.c:885:class_export_put()) final put ffff8d22aea52000/32666111-a0c9-493f-9593-5072557145d9 00000020:00000080:3.0:1789480252.327225:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22aea52000/32666111-a0c9-493f-9593-5072557145d9 for lustre-MDT0000 00000020:00000080:3.0:1789480252.327340:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22aea57800 for lustre-MDT0000 00010000:00010000:0.0:1789480252.443510:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789480252.635183:0:17470:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2187407c60 - data ffff8d22c0240510/ffff8d21874b7400 00000020:01000000:2.0:1789480252.635507:0:17470:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22bb0e4f60 - data ffff8d2282292798/ffff8d229218b000 00000001:00000004:2.0:1789480252.646621:0:17470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1789480252.759244:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789480252.759257:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1789480252.759332:0:17470:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480252.759336:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789480252.760671:0:14349:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789480252.760680:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1789480252.760696:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789480252.763113:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789480252.763125:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789480252.763195:0:17470:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480252.763199:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789480252.779045:0:14351:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789480252.779078:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1789480252.779103:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789480252.882842:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe4bb 00000020:00000080:2.0:1789480252.882859:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2291649800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480252.883014:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2291649800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789480252.889062:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe4d0 00000020:00000080:2.0:1789480252.889082:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22a0280800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789480252.889104:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789480252.889183:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480252.889187:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0280800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789480252.889196:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789480252.889203:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d22a4ac99c0) has no exports 00000004:01000000:2.0:1789480252.889647:0:17470:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789480252.890099:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe51d 00000020:00000080:2.0:1789480252.890453:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22a0283000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789480252.890473:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789480252.890480:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480252.890490:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789480252.890494:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d22bcb04d40) has no exports 00000020:00000080:2.0:1789480252.890503:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe516 00000020:00000080:2.0:1789480252.890508:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22a0284800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480252.890536:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0283000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789480252.890549:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0284800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789480252.891792:0:17470:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789480252.891803:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789480252.891809:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789480252.891821:0:17470:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480252.891823:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480252.891892:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480252.891905:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789480252.891932:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe508 00000020:00000080:2.0:1789480252.891943:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2186b39000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789480252.891949:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789480252.891954:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480252.891959:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789480252.891964:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8d22bd6b19c0) has no exports 00000020:00000080:2.0:1789480252.891972:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe501 00000020:00000080:1.0:1789480252.891975:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22a0282800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789480252.891976:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2186b3f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480252.891988:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d2186b3b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480252.891998:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b3b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789480252.892006:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480252.892219:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b39000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789480252.892228:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b3f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789480252.892666:0:17470:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789480252.892670:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789480252.892674:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:2.0:1789480252.892679:0:17470:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480252.892681:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480252.892763:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480252.892770:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789480252.892802:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480252.892805:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789480252.892809:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d229164f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789480252.892812:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229164f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789480252.892819:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789480252.892976:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe4d7 00000020:00000080:2.0:1789480252.892984:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22a0280000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789480252.897939:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2186b38800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789480252.897969:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d2186b3a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480252.897974:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b3a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789480252.897985:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789480252.898596:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789480252.898609:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480252.898623:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789480252.898629:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d22bcb00000) has no exports 00000020:00000080:2.0:1789480252.898668:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480252.898677:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789480252.898689:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe4de 00000020:00000080:2.0:1789480252.898702:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22a0285000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789480252.898713:0:17470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2187178000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789480252.898716:0:17470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2187178000 3 00000020:01000004:2.0:1789480252.898739:0:17470:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2187178000 from lustre-MDT0000 00000020:00000080:2.0:1789480252.898766:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480252.898770:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789480252.898773:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d229164b800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789480252.898776:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229164b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789480252.898786:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789480252.898841:0:17470:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789480252.898845:0:17470:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789480252.898849:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789480252.898853:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480252.898856:0:17470:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789480252.898865:0:17470:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d21876d0000 b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789480252.898871:0:17470:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d22a4accd40) has exports, disconnecting them 00000020:00080000:2.0:1789480252.898877:0:17470:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d21876d0000), last request at 1789480155 00000020:00000080:2.0:1789480252.898897:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe483 00000020:00010000:2.0:1789480252.898902:0:17470:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d21876d0000: total 2 00000100:00080000:2.0:1789480252.898909:0:17470:0:(import.c:65:import_set_state_nolock()) ffff8d21876d6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789480252.898940:0:17470:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d21876d0000): rc 0 00000020:00080000:2.0:1789480252.898945:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d22a4accd40) has no exports 00000100:00100000:2.0:1789480252.899033:0:14321:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d22baea7600:14321] 2 exiting: rc = 0 00000020:00010000:0.0:1789480252.899381:0:14315:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d21876d0000: total 2 00010000:00010000:0.0:1789480252.899398:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480252.899436:0:14315:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d21876d0000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789480252.899473:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe6eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe6e4 expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899494:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39dc00/0xbb972366037fe491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe48a expref: 8 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899506:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe8ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe8a4 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899517:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7800/0xbb972366037fe5a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe5a2 expref: 6 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899531:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39d200/0xbb972366037fe715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe70e expref: 5 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899540:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe5b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe5b0 expref: 4 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899549:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fe89d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe896 expref: 3 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899560:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4600/0xbb972366037fe5e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fe5da expref: 2 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480252.899570:0:14315:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d21876d0000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789480252.899581:0:14315:0:(genops.c:885:class_export_put()) final put ffff8d21876d0000/b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 00010000:00010000:0.0:1789480252.899587:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480252.899598:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480252.899599:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480252.899633:0:14318:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d228348aa00:14318] 0 exiting: rc = 1 00000020:00000080:1.0:1789480252.899702:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0280000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789480252.899708:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d229164f800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789480252.899710:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229164f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789480252.899716:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789480252.899864:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0285000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789480252.899875:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d21876d0000/b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 for MGS 00000020:00000080:1.0:1789480252.899906:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d21876d6000 for MGS 00000100:00100000:3.0:1789480252.902704:0:14320:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d22baea7200:14320] 1 exiting: rc = 0 00000100:00100000:2.0:1789480252.904060:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904071:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904078:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904084:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904090:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904098:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904553:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904568:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904577:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904596:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904603:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904612:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904645:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904654:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904664:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904671:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904677:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904682:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904687:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904693:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904698:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904705:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904710:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904718:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904724:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904731:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904738:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904747:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904754:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904762:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904771:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904778:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904784:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904792:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904799:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904808:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904817:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904824:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904832:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904840:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904847:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904856:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904864:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904872:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904880:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904887:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904893:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904908:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904914:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904920:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904926:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904932:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904938:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904946:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904953:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904961:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904968:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904975:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904984:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904991:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.904999:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.905006:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.905015:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480252.905024:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789480252.908454:0:17470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789480252.908464:0:17470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1789480252.912276:0:17470:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d229c4e86c0 - data ffff8d229c8566c0/ffff8d218701c400 00000020:01000000:2.0:1789480252.912504:0:17470:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22aebef5a0 - data ffff8d229dfe50d8/ffff8d229c542800 00000020:00000080:2.0:1789480252.913121:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe467 00000020:00000080:2.0:1789480252.913130:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d218717a800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789480252.913153:0:17470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2187178000 from MGS, refs=2 00000020:01000004:2.0:1789480252.913157:0:17470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2187178000 2 00000020:01000004:2.0:1789480252.913161:0:17470:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2187178000 from MGS 00000020:00000080:2.0:1789480252.913190:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480252.913199:0:17470:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789480252.913202:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d218717c800/MGS 00000020:00000080:2.0:1789480252.913206:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d218717c800/MGS for MGS 00000020:01000000:2.0:1789480252.913215:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789480252.913345:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789480252.913361:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480252.913368:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789480252.913389:0:17470:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d22a4911800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789480252.913397:0:17470:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff8d22bd6b0000) has exports, disconnecting them 00000020:00080000:2.0:1789480252.913403:0:17470:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d22a4911800), last request at 1789480155 00000020:00000080:2.0:1789480252.913407:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe555 00000020:00080000:2.0:1789480252.913418:0:17470:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22a4911800): rc 0 00000020:00000080:2.0:1789480252.913423:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d22a4911800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789480252.913874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d218717a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480252.913886:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a4911800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789480252.914447:0:17470:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789480252.914454:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480252.914460:0:17470:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789480252.914467:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789480252.914492:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2286ffa000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789480252.914724:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480252.914733:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789480252.914739:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2286ffe000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789480252.914742:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2286ffe000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789480252.914752:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789480252.914816:0:17470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2187178000 1 00000020:00000080:0.0:1789480252.914822:0:17470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe459 00000020:00000080:0.0:1789480252.914828:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2187178800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789480252.914837:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789480252.914845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2187178800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480252.914854:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480252.914859:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480252.914863:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d22a4ac8000) has no exports 00000020:00000080:0.0:1789480252.947955:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480252.947976:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789480252.947984:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d218717d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789480252.947990:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d218717d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789480252.947999:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789480252.948268:0:17470:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d218717e800 00000020:01000000:0.0:1789480252.948324:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789480252.948342:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480252.948358:0:17470:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480252.948364:0:17470:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d22b99c4d40) has no exports 00000100:00100000:3.0:1789480252.954494:0:14326:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d22b23e9000:14326] 0 exiting: rc = 1 00000100:00100000:0.0:1789480252.962635:0:14327:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d22b23e9a00:14327] 1 exiting: rc = 0 00000100:00100000:0.0:1789480252.962775:0:14328:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d22b23e9200:14328] 2 exiting: rc = 0 00000100:00100000:2.0:1789480252.962868:0:16619:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d2185d87e00:16619] 3 exiting: rc = 0 00000100:00100000:0.0:1789480252.963244:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963255:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963265:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963273:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963280:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963317:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963325:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963332:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963339:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963360:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963368:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963374:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963381:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963402:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963409:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963416:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963423:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963430:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963444:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963451:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963462:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963468:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963477:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963484:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963491:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963501:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963507:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963514:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963521:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963528:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963551:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963557:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963565:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963573:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963580:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963587:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963593:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963600:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963606:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963613:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963626:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963636:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963647:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963656:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963666:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963673:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963680:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963691:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963698:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963710:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963716:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963728:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963736:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963742:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963749:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963757:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963764:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963771:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963777:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963783:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963789:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963796:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963802:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.963809:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.976965:0:14330:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d22b23e8000:14330] 1 exiting: rc = 0 00000100:00100000:0.0:1789480252.977548:0:14329:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d22b23e8600:14329] 0 exiting: rc = 1 00000100:00100000:1.0:1789480252.978458:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978469:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978480:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978487:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978494:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978499:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978504:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978509:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978515:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978520:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978525:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978531:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978537:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978543:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978548:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978577:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978582:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978587:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978592:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978597:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978602:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978608:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978614:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978619:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978625:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978631:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978637:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978642:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978648:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978653:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978659:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978664:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978670:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978675:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978681:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978686:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978693:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978699:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978705:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978711:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978717:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978723:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978728:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978734:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978739:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978745:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978751:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978758:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978765:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978771:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978786:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978791:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978797:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978804:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978809:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978815:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978821:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978826:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978832:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978838:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978844:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978850:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978856:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.978862:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480252.979607:0:14332:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d2287e6a000:14332] 1 exiting: rc = 0 00000100:00100000:3.0:1789480252.982239:0:14331:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d2185f41200:14331] 0 exiting: rc = 1 00000100:00100000:1.0:1789480252.984050:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984064:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984092:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984116:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984124:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984133:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984140:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984146:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984154:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984161:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984169:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984176:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984182:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984189:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984196:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984217:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984226:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984232:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984239:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984248:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984254:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984310:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984318:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984325:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984331:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984339:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984356:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984381:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984400:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984409:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984416:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984423:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984430:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984438:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984444:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984451:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984458:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984467:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984474:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984500:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984510:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984517:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984525:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984532:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984541:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984549:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984557:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984564:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984574:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984582:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984593:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984614:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984623:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984630:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984638:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984645:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984658:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984666:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984673:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984680:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984687:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984695:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984703:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480252.984711:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.011523:0:14333:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d2287e6bc00:14333] 0 exiting: rc = 1 00000100:00100000:0.0:1789480253.011958:0:14334:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d229c768800:14334] 1 exiting: rc = 0 00000100:00100000:0.0:1789480253.012029:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012036:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012043:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012048:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012054:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012061:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012066:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012072:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012078:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012084:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012090:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012096:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012102:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012108:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012114:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012120:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012126:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012132:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012138:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012144:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012163:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012170:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012175:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012181:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012188:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012193:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012199:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012205:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012211:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012217:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012244:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012252:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012260:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012266:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012272:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012278:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012308:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012315:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012320:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012326:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012331:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012337:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012344:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012360:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012366:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012372:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012378:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012384:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012390:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012397:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012402:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012407:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012412:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012418:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012424:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012429:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012434:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012440:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012446:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012453:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012459:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012464:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012470:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.012476:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014416:0:14335:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d22876d6600:14335] 0 exiting: rc = 1 00000100:00100000:1.0:1789480253.014419:0:14336:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d22876d6200:14336] 1 exiting: rc = 0 00000100:00100000:0.0:1789480253.014549:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014557:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014562:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014567:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014573:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014578:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014584:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014602:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014609:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014615:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014619:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014625:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014631:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014636:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014642:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014647:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014652:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014657:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014663:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014669:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014674:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014680:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014685:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014691:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014697:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014703:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014709:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014715:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014721:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014735:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014740:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014746:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014751:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014758:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014765:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014782:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014788:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014795:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014801:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014807:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014812:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014819:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014825:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014831:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014836:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014842:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014847:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014852:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014858:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014864:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014870:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014877:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014882:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014888:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014893:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014899:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014904:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014911:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014916:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014922:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014928:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014935:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014942:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.014948:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.015340:0:14338:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d22876d7c00:14338] 1 exiting: rc = 0 00000100:00100000:0.0:1789480253.022957:0:14337:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d22876d7400:14337] 0 exiting: rc = 1 00000100:00100000:0.0:1789480253.023171:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023181:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023187:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023194:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023218:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023224:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023230:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023238:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023249:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023255:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023262:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023268:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023274:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023295:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023303:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023310:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023316:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023321:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023327:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023333:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023339:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023356:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023363:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023369:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023374:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023380:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023386:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023391:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023407:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023414:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023419:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023425:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023431:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023437:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023443:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023449:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023454:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023459:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023465:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023479:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023485:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023491:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023497:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023501:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023507:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023513:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023519:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023524:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023529:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023535:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023540:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023545:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023551:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023557:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023564:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023570:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023576:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023581:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023587:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023593:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023598:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023605:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023611:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.023617:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480253.024969:0:14339:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d22876d7800:14339] 0 exiting: rc = 1 00000100:00100000:0.0:1789480253.025010:0:14340:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d22ba116e00:14340] 1 exiting: rc = 0 00000100:00100000:0.0:1789480253.025305:0:14341:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d22bab07200:14341] 2 exiting: rc = 0 00000100:00100000:0.0:1789480253.025392:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025414:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025421:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025426:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025433:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025439:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025445:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025468:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025519:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025527:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025534:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025541:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025546:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025552:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025559:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025565:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025572:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025581:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025589:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025596:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025603:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025611:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025620:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025628:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025636:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025644:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025652:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025660:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025667:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025674:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025681:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025689:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025712:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025720:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025971:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025978:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025985:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025991:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.025998:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026004:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026012:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026019:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026025:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026043:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026051:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026058:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026064:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026071:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026077:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026084:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026090:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026097:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026103:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026110:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026117:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026124:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026496:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026509:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026515:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026521:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026528:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026535:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026541:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480253.026548:0:17470:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789480253.034889:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480253.034907:0:17470:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789480253.034916:0:17470:0:(genops.c:885:class_export_put()) final put ffff8d2187d3e800/MDS_uuid 00000020:00000080:1.0:1789480253.034922:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2187d3e800/MDS_uuid for MDS 00000020:01000000:1.0:1789480253.034929:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789480253.035115:0:17470:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789480253.466564:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789480253.867767:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789480253.867780:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d229c50c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789480253.867823:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789480253.867876:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d229c508800 for lustre-OST0000 00010000:00010000:0.0:1789480254.490514:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480255.516979:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789480255.835177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789480255.835185:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789480255.835189:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d22bb590000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480255.835197:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789480255.835204:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789480255.835217:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d22bb590000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480255.835241:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187730a80 x1876405552012544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480255.835266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789480255.835270:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789480255.835272:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2185475000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480255.835275:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789480255.835278:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789480255.835327:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2185475000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480255.835530:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405552012544:0@lo:38:kworker.0 00000400:00000100:1.0:1789480255.835585:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405552012544 offset 0 length 520: 4 00000100:00100000:0.0:1789480255.835792:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552012416:0@lo:400:kworker.0 00000400:00000100:0.0:1789480255.835821:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405552012416 offset 0 length 224: 4 00000100:00100000:2.0:1789480255.836334:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187731f80 x1876405552012672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480255.837765:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405552012672:0@lo:38:kworker.0 00000400:00000100:1.0:1789480255.837833:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405552012672 offset 0 length 520: 4 00000020:01000004:0.0:1789480256.498159:0:17623:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789480256.522240:0:17623:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789480256.522540:0:17623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.522556:0:17623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.522564:0:17623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.522660:0:17623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.522725:0:17623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789480256.522731:0:17623:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789480256.522755:0:17623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480256.522766:0:17623:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187730a80 x1876405552012544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480256.522792:0:17623:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789480256.522799:0:17623:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789480256.522805:0:17623:0:(import.c:65:import_set_state_nolock()) ffff8d22bb590000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789480256.522811:0:17623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480256.522814:0:17623:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187730a80 x1876405552012544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480270 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480256.522821:0:17623:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789480256.522824:0:17623:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1789480256.522875:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405552012544:0@lo:38:kworker.0 00010000:00010000:0.0:1789480256.523796:0:17623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.523807:0:17623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.523814:0:17623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.523820:0:17623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.524403:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480256.524411:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.524420:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480256.524423:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.524432:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480256.524441:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480256.524447:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480256.524449:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789480256.524453:0:14315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789480256.524493:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.524500:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789480256.524563:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552012800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480256.524641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480256.524756:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552012800 00000100:00100000:1.0:1789480256.524765:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552012800 00000100:00100000:1.0:1789480256.524815:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480256.524825:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3301:x1876405552012800:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789480256.524831:0:14313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480256 with bad export cookie 13517311727628182659 00010000:00010000:2.0:1789480256.533359:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.533379:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.533400:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480256.533421:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.533429:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4e00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480256.533433:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.533443:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480256.533450:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480256.533455:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480256.533458:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1789480256.533495:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.533501:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480256.533530:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480256.533538:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480256.533539:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480256.533542:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480256.533663:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552012928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480256.533736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480256.533796:0:14312:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789480256.533804:0:14312:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789480256.534111:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552012928 00000100:00100000:2.0:1789480256.534118:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552012928 00000100:00100000:2.0:1789480256.534214:0:17624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789480256.534223:0:17624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3298:x1876405552012928:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789480256.534229:0:17624:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480256 with bad export cookie 13517311727628182659 00000100:00100000:2.0:1789480256.534275:0:17624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3298:x1876405552012928:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (537us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789480256.534319:0:17624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789480256.534369:0:3298:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789480256.534374:0:3298:0:(import.c:65:import_set_state_nolock()) ffff8d2291db8000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789480256.534378:0:3298:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789480256.535098:0:17623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480256.535108:0:17623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.535133:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480256.535155:0:17623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.535163:0:17623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.535170:0:17623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.535176:0:17623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480256.535191:0:17623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789480256.535197:0:17623:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1789480256.535201:0:17623:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789480256.535229:0:17623:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789480256.535233:0:17623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789480256.535239:0:17623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480256.535245:0:17623:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480256.535249:0:17623:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d22b99c3380) has no exports 00000020:00080000:0.0:1789480256.535303:0:17623:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d22b99c3380) has no exports 00000020:01000000:0.0:1789480256.543564:0:17623:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2290ae1540 - data ffff8d229df22438/ffff8d2185632c00 00000020:01000000:0.0:1789480256.543720:0:17623:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22a4bfd9c0 - data ffff8d229df7ce58/ffff8d218647ac00 00000100:00100000:1.0:1789480256.548259:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3301:x1876405552012800:12345-0@lo:103:ldlm_bl.0 Request processed in 23427us (23611us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480256.548273:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789480256.548381:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1789480256.548428:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480256.548437:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480256.548448:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480256.548453:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480256.548462:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480256.548481:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480256.548486:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789480256.548488:0:14314:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789480256.548491:0:14314:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789480256.565368:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789480256.577311:0:3298:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789480256.577317:0:3298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789480256.577329:0:3298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187732680 x1876405552012416/t0(0) o400->MGC192.168.204.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789480271 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480256.577353:0:3298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187730000 x1876405552012800/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480272 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480256.577364:0:3298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187731180 x1876405552012928/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480272 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789480256.577579:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789480256.577582:0:3298:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789480256.577584:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789480256.578411:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552012416:0@lo:400:kworker.0 00000100:00080000:1.0:1789480256.578689:0:3301:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d2291db8000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789480256.578708:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552012800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480256.582032:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480256.582049:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1789480256.582069:0:3298:0:(import.c:65:import_set_state_nolock()) ffff8d2291db8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480256.582078:0:3298:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 448 00010000:00010000:1.0:1789480256.582081:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480256.582088:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789480256.582090:0:3298:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8d2291db8000 using connection 192.168.204.154@tcp/0@lo 00010000:00010000:1.0:1789480256.582108:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480256.582110:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480256.582113:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480256.582250:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:0:1876405552013056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480256.582349:0:3298:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187732d80 x1876405552013184/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480256.582391:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552012928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480256.582439:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3297:1876405552013184:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789480256.582491:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405552013184 offset 0 length 520: 4 00100000:10000000:0.0:1789480256.601033:0:17623:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789480256.639173:0:17623:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe5c5 00000020:00000080:2.0:1789480256.639195:0:17623:0:(genops.c:885:class_export_put()) final put ffff8d22bb0df800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789480256.639213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb0df800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1789480256.639226:0:17623:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2286ffc000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789480256.639229:0:17623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2286ffc000 2 00000020:01000004:2.0:1789480256.639233:0:17623:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2286ffc000 from lustre-OST0000 00000020:00000080:2.0:1789480256.639256:0:17623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480256.639266:0:17623:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789480256.639269:0:17623:0:(genops.c:885:class_export_put()) final put ffff8d2283305000/lustre-OST0000_UUID 00000020:00000080:2.0:1789480256.639271:0:17623:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283305000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789480256.639313:0:17623:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789480256.639352:0:17623:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789480256.639356:0:17623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789480256.639360:0:17623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480256.639366:0:17623:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789480256.639986:0:17623:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d229c50f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789480256.639993:0:17623:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8d22b99c0000) has exports, disconnecting them 00000020:00080000:2.0:1789480256.639998:0:17623:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d229c50f800), last request at 1789480171 00000020:00000080:2.0:1789480256.640002:0:17623:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe5ef 00000020:00080000:2.0:1789480256.640012:0:17623:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d229c50f800): rc 0 00000020:00000080:2.0:1789480256.640017:0:17623:0:(genops.c:885:class_export_put()) final put ffff8d229c50f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789480256.640104:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789480256.644324:0:17623:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789480256.644332:0:17623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789480256.644336:0:17623:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789480256.644343:0:17623:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789480256.644549:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22bb590000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789480256.644569:0:17623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480256.644577:0:17623:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789480256.644583:0:17623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2286ffc000 1 00000020:00000080:2.0:1789480256.644589:0:17623:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe594 00000020:00000080:2.0:1789480256.644598:0:17623:0:(genops.c:885:class_export_put()) final put ffff8d2283302000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789480256.644612:0:17623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789480256.644627:0:17623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480256.644632:0:17623:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789480256.644636:0:17623:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d22bd6b3380) has no exports 00000020:00000080:0.0:1789480256.645721:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2283303800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789480256.645726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283303800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789480256.645735:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789480256.646221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283302000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789480256.667506:0:17623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480256.667522:0:17623:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789480256.667528:0:17623:0:(genops.c:885:class_export_put()) final put ffff8d22a4912800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789480256.667533:0:17623:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a4912800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789480256.667541:0:17623:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789480256.667856:0:17623:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d22a4915000 00000020:02000400:0.0:1789480256.667907:0:17623:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789480257.562951:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480258.590810:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480259.617972:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789480259.721002:0:17774:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789480259.738415:0:17774:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789480259.738494:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.738509:0:17774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.738517:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.738523:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.738542:0:17774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789480259.738547:0:17774:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789480259.738569:0:17774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789480259.738582:0:17774:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187731f80 x1876405552012672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480259.738616:0:17774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789480259.738624:0:17774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789480259.738632:0:17774:0:(import.c:65:import_set_state_nolock()) ffff8d2185475000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789480259.738637:0:17774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789480259.738641:0:17774:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187731f80 x1876405552012672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480270 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480259.738648:0:17774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789480259.738651:0:17774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1789480259.738740:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405552012672:0@lo:38:kworker.0 00010000:00010000:3.0:1789480259.740047:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740062:0:17774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740069:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740076:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740254:0:17774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789480259.740263:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740271:0:17774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740278:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480259.740309:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740529:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789480259.740537:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740545:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646600 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480259.740549:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740559:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480259.740566:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480259.740572:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480259.740575:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789480259.740577:0:14315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789480259.740590:0:14315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2291db8000 00010000:00010000:2.0:1789480259.740593:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740600:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740612:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480259.740615:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740627:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480259.740630:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740636:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480259.740643:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480259.740648:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480259.740651:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789480259.740655:0:14315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2291db8000 00010000:00010000:2.0:1789480259.740658:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740664:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740672:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480259.740675:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740681:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ca00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480259.740683:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740689:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480259.740701:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480259.740707:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789480259.740710:0:14315:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789480259.740714:0:14315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2291db8000 00010000:00010000:2.0:1789480259.740718:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480259.740724:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480259.740726:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480259.740728:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480259.740826:0:17774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789480259.740831:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480259.740845:0:17774:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789480259.740849:0:17774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789480259.740853:0:17774:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789480259.740876:0:17774:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789480259.740880:0:17774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789480259.740885:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480259.740891:0:17774:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789480259.740895:0:17774:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d229c7dcd40) has no exports 00000020:00080000:3.0:1789480259.740920:0:17774:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d229c7dcd40) has no exports 00010000:00010000:0.0:1789480259.742988:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480259.744375:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789480259.744441:0:17774:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d218689b060 - data ffff8d2291b1c1b0/ffff8d2185542800 00000020:01000000:3.0:1789480259.744599:0:17774:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22828b1660 - data ffff8d22820b7948/ffff8d21876fe400 00100000:10000000:3.0:1789480259.758456:0:17774:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789480259.790150:0:17774:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe6f9 00000020:00000080:0.0:1789480259.790161:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d22bb0d9800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789480259.790185:0:17774:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22bb597000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789480259.790189:0:17774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22bb597000 2 00000020:01000004:0.0:1789480259.790193:0:17774:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d22bb597000 from lustre-OST0001 00000020:00000080:0.0:1789480259.790238:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480259.790249:0:17774:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789480259.790252:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d229c50f000/lustre-OST0001_UUID 00000020:00000080:0.0:1789480259.790255:0:17774:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789480259.790262:0:17774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789480259.790380:0:17774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3->MGS 00010000:00010000:0.0:1789480259.790398:0:17774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480259.790420:0:17774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480259.790427:0:17774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789480259.790430:0:17774:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789480259.790434:0:17774:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789480259.790448:0:17774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2291db8000 00010000:00010000:0.0:1789480259.790451:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480259.790467:0:17774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480259.790473:0:17774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480259.790478:0:17774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480259.790480:0:17774:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789480259.790481:0:17774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789480259.790491:0:17774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2291db8000 00010000:00010000:0.0:1789480259.790493:0:17774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480259.790508:0:17774:0:(import.c:65:import_set_state_nolock()) ffff8d2291db8000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789480259.790512:0:17774:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789480259.790515:0:17774:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789480259.790516:0:17774:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789480259.790520:0:17774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789480259.790530:0:17774:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187732d80 x1876405552013184/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789480266 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789480259.790557:0:17774:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789480259.790560:0:17774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1789480259.790638:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3297:1876405552013184:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1789480259.790696:0:17774:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789480259.790704:0:17774:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe475 00000020:00000080:0.0:1789480259.790708:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d2187d3c800/b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 00000020:01000000:0.0:1789480259.790712:0:17774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:0.0:1789480259.790717:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480259.790722:0:17774:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789480259.790726:0:17774:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d22a4acb380) has no exports 00000020:00000080:1.0:1789480259.790800:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb0d9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789480259.790811:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2187d3c800/b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 for MGC192.168.204.154@tcp 10000000:01000000:2.0:1789480259.795714:0:14324:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789480259.795950:0:17774:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:0.0:1789480259.795956:0:17774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789480259.795960:0:17774:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789480259.795963:0:17774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789480259.795966:0:17774:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789480259.796026:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480259.796037:0:17774:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3) 00000020:01000000:0.0:1789480259.796045:0:17774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789480259.796052:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480259.796058:0:17774:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789480259.796066:0:17774:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d2187014800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480259.796073:0:17774:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff8d2186a68000) has exports, disconnecting them 00000020:00080000:0.0:1789480259.796078:0:17774:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d2187014800), last request at 1789480189 00000020:00000080:0.0:1789480259.796083:0:17774:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe723 00000020:00080000:0.0:1789480259.796097:0:17774:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2187014800): rc 0 00000020:00000080:0.0:1789480259.796102:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d2187014800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789480259.796897:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2291db8000 for MGC192.168.204.154@tcp 00000020:00000080:1.0:1789480259.796906:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2291dbc800/b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 00000020:00000080:1.0:1789480259.796909:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2291dbc800/b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3 for MGC192.168.204.154@tcp 00000020:01000000:1.0:1789480259.796915:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3) 00000020:00000080:1.0:1789480259.797178:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2187014800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789480259.797459:0:17774:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789480259.797463:0:17774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480259.797467:0:17774:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789480259.797472:0:17774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480259.797505:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2185475000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789480259.797547:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789480259.797706:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1789480259.801502:0:14310:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d22a4be2000:14310] 1 exiting: rc = 0 00000100:00100000:2.0:1789480259.802392:0:14309:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d22882a3000:14309] 0 exiting: rc = 1 00000100:00100000:1.0:1789480259.802504:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.802764:0:14311:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d22925a5200:14311] 0 exiting: rc = 1 00000100:00100000:2.0:1789480259.802973:0:14312:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d22925a5a00:14312] 1 exiting: rc = 0 00000100:00100000:2.0:1789480259.804400:0:17624:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d2282c4f800:17624] 3 exiting: rc = 0 00000100:00100000:1.0:1789480259.815137:0:14313:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d22925a5c00:14313] 2 exiting: rc = 0 00000100:00100000:2.0:1789480259.815345:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815353:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815359:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815365:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815371:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815375:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815381:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815386:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815391:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815411:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815416:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815421:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815426:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815431:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815436:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815441:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815446:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815452:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815457:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815462:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815467:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815472:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815477:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815481:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815485:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815490:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815495:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815499:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815504:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815508:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815512:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815517:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815522:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815526:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815531:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815537:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815542:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815548:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815553:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815558:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815563:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815567:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815572:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815576:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815589:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815594:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815599:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815604:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815608:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815613:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815618:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815623:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815628:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815633:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815638:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815643:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815649:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815655:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815669:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815675:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815681:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815686:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815690:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.815695:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789480259.816346:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480259.816357:0:17774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789480259.816364:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d22a1487000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789480259.816368:0:17774:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a1487000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789480259.816373:0:17774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789480259.816419:0:17774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22bb597000 1 00000020:00000080:2.0:1789480259.816425:0:17774:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe6dd 00000020:00000080:2.0:1789480259.816431:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d22b9aa4000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789480259.816441:0:17774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789480259.816446:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480259.816450:0:17774:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789480259.816454:0:17774:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d22b99c19c0) has no exports 00000020:00000080:1.0:1789480259.816689:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22b9aa4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789480259.839110:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480259.839127:0:17774:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789480259.839133:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d22bb591800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789480259.839138:0:17774:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb591800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789480259.839149:0:17774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789480259.839374:0:17774:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d22bb593800 00000020:01000000:1.0:1789480259.839398:0:17774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789480259.839403:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480259.839407:0:17774:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789480259.839411:0:17774:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8d22bcb019c0) has no exports 00000020:00000080:1.0:1789480259.839435:0:17774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480259.839442:0:17774:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789480259.839445:0:17774:0:(genops.c:885:class_export_put()) final put ffff8d2283301000/OSS_uuid 00000020:00000080:1.0:1789480259.839447:0:17774:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283301000/OSS_uuid for OSS 00000020:01000000:1.0:1789480259.839450:0:17774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789480259.839478:0:14322:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789480259.839626:0:15738:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d228492ae00:15738] 3 exiting: rc = 0 00000100:00100000:1.0:1789480259.839678:0:15012:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d21875fd200:15012] 2 exiting: rc = 0 00000100:00100000:1.0:1789480259.839721:0:15010:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d21875fda00:15010] 0 exiting: rc = 1 00000100:00100000:1.0:1789480259.840666:0:15011:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d21875fd000:15011] 1 exiting: rc = 0 00000100:00100000:1.0:1789480259.840736:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840744:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840762:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840768:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840775:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840780:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840797:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840801:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840807:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840814:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840928:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840935:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840941:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840946:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840951:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840956:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840961:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840967:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840972:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840977:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840983:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840989:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840994:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.840999:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841004:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841009:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841015:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841021:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841027:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841032:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841037:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841043:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841048:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841053:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841058:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841063:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841068:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841075:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841081:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841089:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841095:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841107:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841116:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841122:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841128:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841133:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841138:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841143:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841148:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841153:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841159:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841164:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841246:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841253:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841258:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841262:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841267:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841271:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841276:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841299:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841306:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841311:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841316:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.841322:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.845560:0:15013:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d21875fd600:15013] 0 exiting: rc = 1 00000100:00100000:1.0:1789480259.848354:0:15015:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d21875fce00:15015] 1 exiting: rc = 0 00000100:00100000:1.0:1789480259.848462:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848469:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848474:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848480:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848486:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848490:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848494:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848499:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848504:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848509:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848529:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848535:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848540:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848546:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848550:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848556:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848561:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848566:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848571:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848577:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848582:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848587:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848592:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848598:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848603:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848609:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848614:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848619:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848624:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848630:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848636:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848641:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848647:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848652:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848657:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848662:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848668:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848674:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848678:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848683:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848688:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848694:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848699:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848705:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848710:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848723:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848728:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848733:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848738:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848744:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848749:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848767:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848772:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848776:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848781:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848786:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848790:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848795:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848801:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848806:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848812:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848826:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848832:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.848837:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480259.853409:0:15017:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d21873cd600:15017] 1 exiting: rc = 0 00000100:00100000:0.0:1789480259.856665:0:15016:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d22a44e3a00:15016] 0 exiting: rc = 1 00000100:00100000:0.0:1789480259.856885:0:15018:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d21873cc000:15018] 2 exiting: rc = 0 00000100:00100000:1.0:1789480259.857089:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857100:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857105:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857110:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857115:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857120:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857126:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857131:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857136:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857141:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857154:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857160:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857164:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857182:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857188:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857193:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857210:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857226:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857231:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857236:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857241:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857246:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857251:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857256:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857261:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857266:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857272:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857276:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857298:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857305:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857311:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857316:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857321:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857327:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857347:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857354:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857360:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857365:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857372:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857377:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857382:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857388:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857393:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857398:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857403:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857408:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857413:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857418:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857424:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857430:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857436:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857450:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857456:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857462:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857467:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857472:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857477:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857482:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857501:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857508:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857513:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857518:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857523:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.857528:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480259.867322:0:15019:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d21873cc800:15019] 0 exiting: rc = 1 00000100:00100000:1.0:1789480259.867862:0:15020:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d2285fc8200:15020] 1 exiting: rc = 0 00000100:00100000:1.0:1789480259.894944:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.894955:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.894961:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.894974:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.894981:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.894992:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895000:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895224:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895236:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895241:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895247:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895253:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895260:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895266:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895273:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895278:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895305:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895311:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895317:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895323:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895329:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895347:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895353:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895358:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895364:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895370:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895375:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895381:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895386:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895391:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895530:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895536:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895540:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895545:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895549:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895553:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895558:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895562:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895567:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895572:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895577:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895583:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895588:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895593:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895599:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895605:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895610:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895616:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895621:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895627:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895632:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895637:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895643:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895648:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895653:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895728:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895740:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895745:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895749:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895755:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895760:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895766:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895771:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.895777:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.899383:0:15021:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d21875fdc00:15021] 0 exiting: rc = 1 00000100:00100000:1.0:1789480259.900577:0:15022:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d2295373600:15022] 1 exiting: rc = 0 00000100:00100000:1.0:1789480259.900670:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900679:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900686:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900711:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900718:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900724:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900730:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900738:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900743:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900749:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900755:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900760:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900767:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900773:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900778:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900799:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900806:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900811:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900816:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900821:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900827:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900832:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900838:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900844:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900852:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900870:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900876:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900895:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900902:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900907:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900914:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900919:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900924:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900929:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900934:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900940:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900945:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900950:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900956:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900976:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900984:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900991:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.900997:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901002:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901028:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901036:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901042:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901048:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901053:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901062:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901067:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901089:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901097:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901102:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901119:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901127:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901132:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901139:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901145:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901150:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901163:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901168:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901174:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480259.901188:0:17774:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789480259.919375:0:17774:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789480279.283014:0:18387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789480288.403157:0:18848:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789480288.403164:0:18848:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789480288.403361:0:18848:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d218785b000 00000020:01000004:1.0:1789480288.403384:0:18848:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789480288.403395:0:18848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789480288.403415:0:18848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d229c7d8000) 00000020:00000080:1.0:1789480288.403441:0:18848:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789480288.421144:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789480288.423694:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1789480288.424086:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:3.0:1789480288.424516:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:3.0:1789480288.424727:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789480288.424807:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:3.0:1789480288.424909:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:3.0:1789480288.425014:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1789480288.425122:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:3.0:1789480288.425626:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:3.0:1789480288.427105:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 513: rc = 0 00100000:10000000:3.0:1789480288.427460:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 513: rc = 0 00100000:10000000:3.0:1789480288.427915:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1789480288.431744:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:3.0:1789480288.433670:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480288.433988:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480288.434644:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:3.0:1789480288.434936:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480288.435226:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480288.437829:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1789480288.438572:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480288.438879:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1789480288.440439:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480288.443209:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1789480288.443794:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 778: rc = 0 00100000:10000000:3.0:1789480288.444075:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 778: rc = 0 00100000:10000000:3.0:1789480288.444381:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 778: rc = 0 00100000:10000000:3.0:1789480288.444646:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 778: rc = 0 00100000:10000000:3.0:1789480288.444926:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 778: rc = 0 00100000:10000000:3.0:1789480288.445222:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 778: rc = 0 00100000:10000000:3.0:1789480288.445526:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 778: rc = 0 00100000:10000000:3.0:1789480288.450029:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 778: rc = 0 00100000:10000000:3.0:1789480288.450395:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 778: rc = 0 00100000:10000000:3.0:1789480288.450704:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 778: rc = 0 00100000:10000000:3.0:1789480288.450998:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 778: rc = 0 00100000:10000000:3.0:1789480288.451243:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 778: rc = 0 00100000:10000000:3.0:1789480288.451522:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 778: rc = 0 00100000:10000000:3.0:1789480288.451825:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 778: rc = 0 00100000:10000000:3.0:1789480288.452085:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 778: rc = 0 00100000:10000000:3.0:1789480288.456246:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 778: rc = 0 00100000:10000000:3.0:1789480288.456927:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 778: rc = 0 00100000:10000000:3.0:1789480288.457245:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 778: rc = 0 00100000:10000000:3.0:1789480288.457551:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 778: rc = 0 00100000:10000000:3.0:1789480288.457836:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 778: rc = 0 00100000:10000000:3.0:1789480288.458106:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 778: rc = 0 00100000:10000000:3.0:1789480288.462315:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 778: rc = 0 00100000:10000000:3.0:1789480288.465874:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 778: rc = 0 00100000:10000000:3.0:1789480288.466199:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 778: rc = 0 00100000:10000000:3.0:1789480288.466548:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 778: rc = 0 00100000:10000000:3.0:1789480288.466842:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 778: rc = 0 00100000:10000000:3.0:1789480288.467102:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 778: rc = 0 00100000:10000000:3.0:1789480288.467406:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 778: rc = 0 00100000:10000000:3.0:1789480288.467678:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 778: rc = 0 00100000:10000000:3.0:1789480288.467956:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 778: rc = 0 00100000:10000000:3.0:1789480288.472192:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 778: rc = 0 00100000:10000000:3.0:1789480288.472616:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 778: rc = 0 00100000:10000000:3.0:1789480288.473054:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 483: rc = 0 00100000:10000000:3.0:1789480288.476089:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789480288.481587:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 514: rc = 0 00100000:10000000:2.0:1789480288.481881:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789480288.481966:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 514: rc = 0 00100000:10000000:2.0:1789480288.485566:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789480288.485786:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 514: rc = 0 00100000:10000000:2.0:1789480288.486240:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789480288.486349:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 518: rc = 0 00100000:10000000:2.0:1789480288.486554:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789480288.486634:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 518: rc = 0 00100000:10000000:2.0:1789480288.486853:0:18848:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789480288.486924:0:18848:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 518: rc = 0 00000020:00000080:2.0:1789480288.487676:0:18848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789480288.487687:0:18848:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789480288.487702:0:18848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037febbb 00000020:01000004:2.0:1789480288.487713:0:18848:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789480288.487719:0:18848:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789480288.487725:0:18848:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d218785b000 from MGS 00000020:01000004:2.0:1789480288.487731:0:18848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789480288.487745:0:18848:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d21852ab380) 00000020:00000080:2.0:1789480288.487758:0:18848:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789480288.487829:0:18848:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d218785b000 from MGS, refs=2 00080000:01000000:2.0:1789480288.487834:0:18848:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789480288.487840:0:18848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037febc9 00000100:00100000:2.0:1789480288.487977:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789480288.488135:0:18848:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789480288.488142:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789480288.494014:0:18848:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789480288.494033:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789480288.495489:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480288.495743:0:18848:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789480288.495750:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789480288.496535:0:18848:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789480288.496545:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789480288.496968:0:18848:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789480288.496975:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789480288.497887:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480288.497892:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480288.497894:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480288.498251:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480288.498255:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480288.498257:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480288.498994:0:18848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789480288.503635:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789480288.508329:0:18848:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789480288.508355:0:18848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789480288.508358:0:18848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789480288.519526:0:18857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789480288.519788:0:18848:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789480288.519939:0:18848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789480288.520550:0:18848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789480288.520996:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789480288.521203:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789480288.521210:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789480288.522684:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789480288.522696:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789480288.530138:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789480288.530156:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789480288.534752:0:18848:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789480288.534783:0:18848:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:2.0:1789480288.534785:0:18848:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789480288.534823:0:18848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:2.0:1789480288.534839:0:18848:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff8d21852a8000) 00000020:00000080:2.0:1789480288.534858:0:18848:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789480288.534961:0:18848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d218561d000@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1789480288.535143:0:18848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:2.0:1789480288.535151:0:18848:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789480288.537849:0:18862:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789480288.539094:0:18863:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789480288.539213:0:18848:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid 2016df8a-d509-4535-998f-23fecb5de199) 00000020:00000080:3.0:1789480288.539262:0:18848:0:(genops.c:1384:class_connect()) connect: client 2016df8a-d509-4535-998f-23fecb5de199, cookie 0xbb972366037febd7 00000100:00080000:3.0:1789480288.539319:0:18848:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789480288.539335:0:18848:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8d218561d000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789480288.539387:0:18848:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a485f100 x1876405552013312/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789480288.539417:0:18848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2016df8a-d509-4535-998f-23fecb5de199->MGS 00000020:01000004:3.0:1789480288.539444:0:18848:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789480288.539451:0:18848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:2.0:1789480288.539464:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2016df8a-d509-4535-998f-23fecb5de199:3297:1876405552013312:0@lo:250:mount.lustre.0 00000020:00000080:3.0:1789480288.539468:0:18848:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d2186a6cd40) 00000020:00000080:3.0:1789480288.539481:0:18848:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789480288.539549:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480288.539652:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552013312 00000100:00100000:2.0:1789480288.539675:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552013312 00000100:00100000:2.0:1789480288.539714:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480288.540857:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22b9de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876405552013312:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789480288.540900:0:18858:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2016df8a-d509-4535-998f-23fecb5de199@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:2.0:1789480288.540944:0:18858:0:(genops.c:1384:class_connect()) connect: client 2016df8a-d509-4535-998f-23fecb5de199, cookie 0xbb972366037febe5 00000100:00080000:2.0:1789480288.541167:0:18858:0:(import.c:65:import_set_state_nolock()) ffff8d218561f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480288.541303:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22b9de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+5:3297:x1876405552013312:12345-0@lo:250:mount.lustre.0 Request processed in 455us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.541312:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480288.541425:0:3297:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789480288.541437:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:2.0:1789480288.541448:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789480288.541456:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789480288.541460:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d218561d000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789480288.541464:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789480288.541485:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789480288.541495:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2016df8a-d509-4535-998f-23fecb5de199:3297:1876405552013312:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789480288.567342:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480288.567807:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789480288.567815:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789480288.568895:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789480288.568909:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789480288.569999:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789480288.570010:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789480288.570842:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480288.571158:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789480288.571165:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789480288.571956:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789480288.571965:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789480288.652188:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480288.652415:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789480288.652421:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789480288.653686:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789480288.653696:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789480288.654265:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480288.654477:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789480288.654482:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789480288.658679:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789480288.658703:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789480288.659723:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480288.660082:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789480288.660088:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789480288.662772:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789480288.662786:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789480288.667909:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480288.668774:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789480288.668781:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789480288.669837:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789480288.669845:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789480288.692456:0:18848:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480288.692681:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789480288.692688:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789480288.700050:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789480288.700084:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789480288.700922:0:18848:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789480288.700931:0:18848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789480288.702354:0:18848:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789480288.702380:0:18848:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789480288.702387:0:18848:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789480288.702531:0:18848:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789480288.702573:0:18848:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789480288.702577:0:18848:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789480288.702579:0:18848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480288.702580:0:18848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480288.702581:0:18848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480288.702583:0:18848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480288.702584:0:18848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480288.702585:0:18848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480288.702587:0:18848:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480288.702589:0:18848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480288.702590:0:18848:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789480288.702593:0:18848:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789480288.702596:0:18848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789480288.702597:0:18848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480288.702598:0:18848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480288.702600:0:18848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480288.702604:0:18848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480288.702606:0:18848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480288.702607:0:18848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480288.702608:0:18848:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480288.702609:0:18848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480288.702609:0:18848:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789480288.702635:0:18848:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789480288.702666:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013440:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789480288.702739:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480288.702788:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2288b42780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.703267:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552013440 00000100:00100000:2.0:1789480288.703276:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552013440 00000100:00100000:2.0:1789480288.703341:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480288.703352:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+5:18848:x1876405552013440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480288.703405:0:18861:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789480288.703408:0:18861:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789480288.703411:0:18861:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789480288.703719:0:18882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789480288.704053:0:18861:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1789480288.705231:0:18883:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789480288.705238:0:18883:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789480288.705241:0:18883:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789480288.705279:0:18883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789480288.705805:0:18861:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789480288.705818:0:18861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789480288.715852:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+5:18848:x1876405552013440:12345-0@lo:253:mount.lustre.0 Request processed in 12493us (13103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.715867:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480288.716183:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013440:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480288.716199:0:18848:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789480288.716203:0:18848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480288.716205:0:18848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480288.716207:0:18848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480288.716208:0:18848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480288.716210:0:18848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480288.716211:0:18848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480288.716212:0:18848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480288.716214:0:18848:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480288.716216:0:18848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480288.716217:0:18848:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789480288.716347:0:18848:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d218785b000 from lustre-MDT0000 10000000:01000000:0.0:1789480288.716374:0:18848:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789480288.716377:0:18848:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789480288.716381:0:18848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d21852a8000 10000000:01000000:0.0:1789480288.716385:0:18848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789480288.716394:0:18848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d21852a8000 from 1 10000000:01000000:0.0:1789480288.716397:0:18848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789480288.716437:0:18848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480288.716449:0:18848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480288.716477:0:18848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480288.716498:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480288.716538:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480288.716686:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.716800:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552013568 00000100:00100000:3.0:1789480288.716808:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552013568 00000100:00100000:3.0:1789480288.716889:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480288.716898:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+5:18848:x1876405552013568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480288.717027:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480288.717052:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2400/0xbb972366037febf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037febec expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.717076:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2400/0xbb972366037febf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037febec expref: 6 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.717094:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2400/0xbb972366037febf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037febec expref: 6 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.717113:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2400, rc 0) 00000100:00100000:3.0:1789480288.717161:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+6:18848:x1876405552013568:12345-0@lo:101:mount.lustre.0 Request processed in 264us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.717168:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480288.717252:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480288.717266:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.717274:0:18848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.717346:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480288.717369:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.717758:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283757b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480288.717824:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552013696 00000100:00100000:0.0:1789480288.717829:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552013696 00000100:00100000:0.0:1789480288.717851:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480288.717857:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+6:18848:x1876405552013696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480288.718599:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+6:18848:x1876405552013696:12345-0@lo:501:mount.lustre.0 Request processed in 739us (1225us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480288.718691:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480288.718755:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013696:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789480288.718789:0:18848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789480288.718839:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.718850:0:18848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480288.718859:0:18848:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d218785b000 10000000:01000000:1.0:1789480288.718863:0:18848:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789480288.718867:0:18848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d218785b000 10000000:01000000:1.0:1789480288.718870:0:18848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789480288.718873:0:18848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d218785b000 from 1 10000000:01000000:1.0:1789480288.718876:0:18848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789480288.718899:0:18848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.719166:0:18848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.719175:0:18848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.719190:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480288.719224:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.719390:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283757b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.719705:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552013824 00000100:00100000:3.0:1789480288.719711:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552013824 00000100:00100000:3.0:1789480288.719752:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480288.719760:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+6:18848:x1876405552013824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480288.719771:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480288.719785:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2800/0xbb972366037fec01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037febfa expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.719807:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2800/0xbb972366037fec01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037febfa expref: 7 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.719818:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2800/0xbb972366037fec01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037febfa expref: 7 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.719825:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2800, rc 0) 00000100:00100000:3.0:1789480288.719869:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+7:18848:x1876405552013824:12345-0@lo:101:mount.lustre.0 Request processed in 109us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.719875:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789480288.723353:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480288.723380:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec01 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.723394:0:18848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fec01 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480288.723426:0:18848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789480288.723448:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec01 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.723456:0:18848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d800/0xbb972366037febfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec01 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480288.723464:0:18848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789480288.723473:0:18848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480288.723480:0:18848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d218785b000 10000000:01000000:1.0:1789480288.723483:0:18848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789480288.723500:0:18848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789480288.723503:0:18848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789480288.723535:0:18848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.723543:0:18848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.723553:0:18848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.723573:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480288.723644:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.723701:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283757b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.724056:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552013952 00000100:00100000:2.0:1789480288.724065:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552013952 00000100:00100000:2.0:1789480288.724135:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480288.724144:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+7:18848:x1876405552013952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480288.724157:0:18861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480288.724172:0:18861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2187646000/0xbb972366037fec0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fec08 expref: -99 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480288.724195:0:18861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2187646000/0xbb972366037fec0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fec08 expref: 8 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480288.724206:0:18861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2187646000/0xbb972366037fec0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fec08 expref: 8 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480288.724214:0:18861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646000, rc 0) 00000100:00100000:2.0:1789480288.724488:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+8:18848:x1876405552013952:12345-0@lo:101:mount.lustre.0 Request processed in 345us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.724496:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480288.724734:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552013952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480288.724748:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec0f expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.724756:0:18848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fec0f expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.724811:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480288.724841:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.724875:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283757b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.724932:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552014080 00000100:00100000:3.0:1789480288.724937:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552014080 00000100:00100000:3.0:1789480288.724980:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480288.724987:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+8:18848:x1876405552014080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480288.725682:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+9:18848:x1876405552014080:12345-0@lo:501:mount.lustre.0 Request processed in 693us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.725689:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480288.726088:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480288.726435:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480288.726484:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.726530:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283757b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.726733:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552014208 00000100:00100000:3.0:1789480288.726739:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552014208 00000100:00100000:3.0:1789480288.726780:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789480288.726788:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+9:18848:x1876405552014208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480288.727439:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+9:18848:x1876405552014208:12345-0@lo:503:mount.lustre.0 Request processed in 649us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.727448:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480288.727542:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480288.728495:0:18884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18884:1876405552014336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480288.728548:0:18884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480288.728580:0:18884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290dfa840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.728649:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552014336 00000100:00100000:3.0:1789480288.728665:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552014336 00000100:00100000:3.0:1789480288.728703:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789480288.728710:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+9:18884:x1876405552014336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480288.728988:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+9:18884:x1876405552014336:12345-0@lo:502:llog_process_th.0 Request processed in 277us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.728995:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480288.729530:0:18884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18884:1876405552014336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789480288.729562:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480288.729573:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.729576:0:18884:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789480288.729581:0:18884:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789480288.729584:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789480288.729599:0:18884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d21852acd40) 00000020:00000080:2.0:1789480288.729629:0:18884:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789480288.729635:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789480288.729715:0:18884:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789480288.729722:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fec1d 00000020:00000080:2.0:1789480288.729957:0:18884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789480288.729962:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480288.729965:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.729967:0:18884:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789480288.729970:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480288.729973:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.729975:0:18884:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789480288.729979:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789480288.729987:0:18884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d21852a99c0) 00000020:00000080:2.0:1789480288.729997:0:18884:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789480288.730000:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789480288.730003:0:18884:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789480288.730006:0:18884:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789480288.730012:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789480288.730358:0:18884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d218785b000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789480288.730373:0:18884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d22a4acb380) 00000020:00000080:2.0:1789480288.730383:0:18884:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789480288.730430:0:18884:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789480288.730435:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fec32 00000020:00000080:2.0:1789480288.730526:0:18884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789480288.730532:0:18884:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789480288.730537:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbb972366037fec39 00080000:01000000:2.0:1789480288.730542:0:18884:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789480288.730545:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fec40 00010000:00010000:2.0:1789480288.913628:0:18884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789480288.914587:0:18884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:2.0:1789480288.915677:0:18884:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789480288.918484:0:18884:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d22a4ac8000) 00000020:00000080:2.0:1789480288.918507:0:18884:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789480288.918600:0:18884:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789480288.918609:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fec4e 00000020:00000080:3.0:1789480288.921623:0:18884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789480288.937035:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbb972366037fec55 00000020:00000080:0.0:1789480288.937526:0:18884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789480288.937536:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480288.937542:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.937544:0:18884:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789480288.937548:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480288.937553:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.937555:0:18884:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789480288.937558:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789480288.937591:0:18884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789480288.937603:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480288.937606:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.937607:0:18884:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789480288.937610:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789480288.937612:0:18884:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789480288.937621:0:18884:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480288.937623:0:18884:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480288.937625:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789480288.937627:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.937628:0:18884:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789480288.937631:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789480288.937634:0:18884:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789480288.937637:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.937639:0:18884:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789480288.937642:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789480288.937663:0:18884:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1789480288.937690:0:18884:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789480288.937693:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480288.937707:0:18884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d22b99c0000) 00000020:00000080:0.0:1789480288.937720:0:18884:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789480288.937725:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789480288.944268:0:18884:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789480288.944279:0:18884:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789480288.944549:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fec63 00010000:00080000:1.0:1789480288.944614:0:18884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22bb3bc800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789480288.944857:0:18884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789480288.945937:0:18884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789480288.945986:0:18884:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789480288.951464:0:18884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480288.951537:0:18884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789480288.951600:0:18884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1789480288.953267:0:18888:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789480288.953273:0:18888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789480288.954169:0:18884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480288.954181:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789480288.954215:0:18884:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789480288.954235:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fec6a 00000100:00080000:0.0:1789480288.954245:0:18884:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480288.954258:0:18884:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d22bb3bc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480288.954334:0:18884:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4bb7480 x1876405552014464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480288.954356:0:18884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789480288.954628:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480288.954633:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.954635:0:18884:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789480288.954638:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789480288.954641:0:18884:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789480288.954643:0:18884:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480288.954645:0:18884:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480288.954666:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789480288.954669:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.954670:0:18884:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789480288.954673:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789480288.954678:0:18884:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789480288.954681:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.954682:0:18884:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789480288.954685:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789480288.954689:0:18884:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1789480288.954711:0:18884:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789480288.954714:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480288.954725:0:18884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d22b99c19c0) 00000020:00000080:0.0:1789480288.954737:0:18884:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789480288.954741:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789480288.954791:0:18884:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789480288.954797:0:18884:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789480288.954802:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fec78 00010000:00080000:0.0:1789480288.954828:0:18884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d229c447000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00000100:00100000:2.0:1789480288.955223:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552014464:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789480288.955278:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405552014464 offset 0 length 520: 4 00010000:00010000:0.0:1789480288.956614:0:18884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789480288.956815:0:18884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789480288.956837:0:18884:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789480288.957891:0:18884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789480288.957959:0:18884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789480288.958064:0:18884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1789480288.961612:0:18890:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789480288.961619:0:18890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789480288.962224:0:18884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480288.962236:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789480288.962269:0:18884:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789480288.962360:0:18884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fec7f 00000100:00080000:0.0:1789480288.962370:0:18884:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480288.962382:0:18884:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d229c447000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480288.962437:0:18884:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4bb6d80 x1876405552014592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480288.962493:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552014592:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789480288.962547:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405552014592 offset 0 length 520: 4 00000100:00080000:0.0:1789480288.962603:0:18884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789480288.962677:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480288.962681:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.962682:0:18884:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789480288.962686:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480288.962690:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.962691:0:18884:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789480288.962693:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789480288.962695:0:18884:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789480288.962697:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480288.962699:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.962700:0:18884:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789480288.962702:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480288.962703:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.962704:0:18884:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789480288.962707:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789480288.962731:0:18884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18884:1876405552014720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480288.962787:0:18884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480288.962808:0:18884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a15becc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.963006:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552014720 00000100:00100000:2.0:1789480288.963013:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552014720 00000100:00100000:2.0:1789480288.963088:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480288.963098:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+9:18884:x1876405552014720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480288.963342:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+9:18884:x1876405552014720:12345-0@lo:502:llog_process_th.0 Request processed in 245us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.963350:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789480288.963438:0:18884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18884:1876405552014720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789480288.963463:0:18884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480288.963468:0:18884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480288.963469:0:18884:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789480288.963473:0:18884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789480288.963682:0:18848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789480288.963700:0:18848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789480288.963721:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec0f expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.963733:0:18848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39da00/0xbb972366037fec08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec0f expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480288.963741:0:18848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d218785b000 from 1 10000000:01000000:1.0:1789480288.963743:0:18848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789480288.963767:0:18848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.963775:0:18848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.963785:0:18848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.963808:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480288.963837:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.963967:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.964021:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552014848 00000100:00100000:3.0:1789480288.964026:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552014848 00000100:00100000:3.0:1789480288.964049:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480288.964056:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+9:18848:x1876405552014848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480288.964065:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480288.964078:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fec86 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.964111:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fec86 expref: 10 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.964120:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fec86 expref: 10 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.964129:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2600, rc 0) 00000100:00100000:3.0:1789480288.964171:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+10:18848:x1876405552014848:12345-0@lo:101:mount.lustre.0 Request processed in 115us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.964177:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480288.964251:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480288.964262:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.964272:0:18848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.965001:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014976:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789480288.965047:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.965076:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.965145:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552014976 00000100:00100000:3.0:1789480288.965150:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552014976 00000100:00100000:3.0:1789480288.965174:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480288.965180:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+10:18848:x1876405552014976:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789480288.965193:0:18860:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789480288.965199:0:18860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789480288.965265:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+10:18848:x1876405552014976:12345-0@lo:256:mount.lustre.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.965271:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480288.965397:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552014976:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789480288.966326:0:18848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789480288.966341:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.966350:0:18848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480288.966358:0:18848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d218785b000 from 1 10000000:01000000:1.0:1789480288.966361:0:18848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480288.966391:0:18848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.966410:0:18848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.966421:0:18848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480288.966441:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480288.966483:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.966516:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.966633:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015104 00000100:00100000:2.0:1789480288.966639:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015104 00000100:00100000:1.0:1789480288.966900:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480288.966909:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+10:18848:x1876405552015104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480288.966920:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480288.966933:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fec94 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.966953:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fec94 expref: 11 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.966964:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fec94 expref: 11 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480288.966972:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d200, rc 0) 00000100:00100000:1.0:1789480288.967011:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552015104:12345-0@lo:101:mount.lustre.0 Request processed in 104us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480288.967017:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789480288.967090:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480288.967103:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480288.967111:0:18848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480288.967162:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480288.967190:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480288.967435:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290dfa840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480288.967515:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015232 00000100:00100000:0.0:1789480288.967520:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015232 00000100:00100000:0.0:1789480288.967542:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789480288.967548:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552015232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480288.967908:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552015232:12345-0@lo:501:mount.lustre.0 Request processed in 359us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480288.967915:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789480288.967980:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480288.968020:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480288.968055:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480288.968080:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290dfa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789480288.968128:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015360 00000100:00100000:1.0:1789480288.968132:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015360 00000100:00100000:1.0:1789480288.968313:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480288.968321:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552015360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480288.968477:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552015360:12345-0@lo:503:mount.lustre.0 Request processed in 156us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480288.968484:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789480288.968567:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480288.968908:0:18892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18892:1876405552015488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480288.968942:0:18892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480288.969008:0:18892:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290dfa180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.969035:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015488 00000100:00100000:3.0:1789480288.969039:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015488 00000100:00100000:3.0:1789480288.969087:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480288.969095:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+11:18892:x1876405552015488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480288.969279:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+11:18892:x1876405552015488:12345-0@lo:502:llog_process_th.0 Request processed in 184us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.969317:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789480288.969464:0:18892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18892:1876405552015488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789480288.969487:0:18892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480288.969497:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.969500:0:18892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789480288.969507:0:18892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d218785b000 00000020:00000080:2.0:1789480288.969509:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789480288.969516:0:18892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480288.969518:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.969519:0:18892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789480288.969521:0:18892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480288.969523:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.969524:0:18892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789480288.969527:0:18892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d218785b000 00000020:00000080:2.0:1789480288.969529:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789480288.969573:0:18892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480288.969575:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.969576:0:18892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789480288.969578:0:18892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480288.969580:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.969581:0:18892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789480288.969584:0:18892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d218785b000 00000020:00000080:2.0:1789480288.969586:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789480288.969620:0:18892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18892:1876405552015616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480288.969666:0:18892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480288.969687:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015616 00000100:00100000:2.0:1789480288.969691:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015616 00000100:00100000:2.0:1789480288.969717:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480288.969724:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+11:18892:x1876405552015616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480288.969849:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+11:18892:x1876405552015616:12345-0@lo:502:llog_process_th.0 Request processed in 124us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.969861:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480288.969894:0:18892:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.969905:0:18892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18892:1876405552015616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789480288.969922:0:18892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480288.969926:0:18892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480288.969927:0:18892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789480288.969930:0:18892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789480288.970074:0:18848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789480288.970093:0:18848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480288.970528:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970540:0:18848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480288.970580:0:18848:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789480288.970583:0:18848:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d218785b000 10000000:01000000:3.0:1789480288.970586:0:18848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d218785b000 10000000:01000000:3.0:1789480288.970589:0:18848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789480288.970594:0:18848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d218785b000 from 1 10000000:01000000:3.0:1789480288.970597:0:18848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789480288.970623:0:18848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970631:0:18848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970641:0:18848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480288.970667:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480288.970696:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480288.970713:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.970729:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015744 00000100:00100000:3.0:1789480288.970733:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015744 00000100:00100000:3.0:1789480288.970758:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480288.970764:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552015744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480288.970779:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480288.970790:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d3000/0xbb972366037feca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037feca2 expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970810:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d3000/0xbb972366037feca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037feca2 expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970820:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d3000/0xbb972366037feca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037feca2 expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970829:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d3000, rc 0) 00000100:00100000:3.0:1789480288.970858:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:18848:x1876405552015744:12345-0@lo:101:mount.lustre.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.970865:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480288.970901:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480288.970913:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feca9 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480288.970922:0:18848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037feca9 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480288.970962:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480288.970984:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480288.970995:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.971117:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552015872 00000100:00100000:2.0:1789480288.971122:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552015872 00000100:00100000:2.0:1789480288.971143:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480288.971149:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:18848:x1876405552015872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480288.971395:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:18848:x1876405552015872:12345-0@lo:501:mount.lustre.0 Request processed in 245us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.971402:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789480288.971476:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552015872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480288.971504:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552016000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480288.971537:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480288.971566:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a15bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.971606:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016000 00000100:00100000:2.0:1789480288.971610:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016000 00000100:00100000:2.0:1789480288.971681:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789480288.971687:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18848:x1876405552016000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480288.971811:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18848:x1876405552016000:12345-0@lo:503:mount.lustre.0 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.971821:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789480288.971930:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552016000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480288.979472:0:18894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18894:1876405552016128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480288.979553:0:18894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.979606:0:18894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a1721780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480288.979807:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016128 00000100:00100000:2.0:1789480288.979816:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016128 00000100:00100000:2.0:1789480288.979876:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789480288.979884:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:18894:x1876405552016128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480288.980154:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:18894:x1876405552016128:12345-0@lo:502:llog_process_th.0 Request processed in 271us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480288.980163:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789480288.980811:0:18894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18894:1876405552016128:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789480288.980879:0:18894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789480288.981630:0:18894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d229c7db380) 00000020:00000080:1.0:1789480288.981667:0:18894:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789480288.981752:0:18894:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d218785b000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789480288.981756:0:18894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d218785b000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789480288.981759:0:18894:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d218785b000 4 00010000:00080000:1.0:1789480288.981788:0:18894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22bb0da000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789480288.988704:0:18894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789480288.993504:0:18894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789480288.993546:0:18894:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789480288.993561:0:18894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbb972366037fecb7 00000100:00080000:1.0:1789480288.993574:0:18894:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789480288.993587:0:18894:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d22bb0da000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480288.993656:0:18894:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd786d80 x1876405552016256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480288.993699:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405552016256:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480288.993769:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789480288.993852:0:18894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789480288.994485:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016256 00000100:00100000:0.0:1789480288.994494:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016256 00000100:00100000:0.0:1789480288.994525:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480288.994533:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405552016256:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789480288.994594:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405552016256:12345-0@lo:38:llog_process_th.0 Request processed in 61us (825us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789480288.994601:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480288.994662:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789480288.994671:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb0da000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480288.994675:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789480288.994679:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405552016256:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480288.997464:0:18894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd787480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18894:1876405552016384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480288.997541:0:18894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480288.997583:0:18894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228a3ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480288.998004:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016384 00000100:00100000:3.0:1789480288.998011:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016384 00000100:00100000:3.0:1789480288.998169:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480288.998180:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:18894:x1876405552016384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480288.998487:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:18894:x1876405552016384:12345-0@lo:502:llog_process_th.0 Request processed in 307us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480288.998495:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480288.999018:0:18894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd787480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2016df8a-d509-4535-998f-23fecb5de199:18894:1876405552016384:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789480288.999052:0:18894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789480288.999382:0:18848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789480288.999454:0:18848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789480288.999509:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feca9 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480288.999522:0:18848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037feca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feca9 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789480288.999576:0:18848:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789480288.999579:0:18848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480288.999580:0:18848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480288.999582:0:18848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480288.999583:0:18848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480288.999585:0:18848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480288.999586:0:18848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480288.999588:0:18848:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480288.999589:0:18848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480288.999591:0:18848:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480288.999595:0:18848:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789480288.999597:0:18848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789480288.999599:0:18848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480288.999600:0:18848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480288.999601:0:18848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480288.999603:0:18848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480288.999604:0:18848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480288.999605:0:18848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480288.999606:0:18848:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480288.999607:0:18848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480288.999608:0:18848:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480288.999626:0:18848:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789480288.999641:0:18848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552016512:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789480288.999700:0:18848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480288.999737:0:18848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a15be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480288.999795:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016512 00000100:00100000:1.0:1789480288.999800:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016512 00000100:00100000:1.0:1789480288.999838:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789480288.999846:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18848:x1876405552016512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789480288.999880:0:18861:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789480288.999893:0:18861:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789480289.083329:0:18861:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789480289.083347:0:18861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789480289.083617:0:18882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789480289.083622:0:18882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789480289.083654:0:18882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.083674:0:18882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fec86 expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.083683:0:18882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.083723:0:18882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fec86 expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.083739:0:18882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fec86 expref: 12 pid: 18860 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480289.083753:0:18882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18882:1876405552016640:0@lo:104: 00000100:00100000:2.0:1789480289.083810:0:18882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480289.083861:0:18882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789480289.085691:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016640 00000100:00100000:1.0:1789480289.085705:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016640 00000100:00100000:1.0:1789480289.085761:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480289.085772:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2016df8a-d509-4535-998f-23fecb5de199+3:18882:x1876405552016640:12345-0@lo:104: 00010000:00010000:1.0:1789480289.085788:0:18849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480289.085883:0:18849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480289.085889:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2016df8a-d509-4535-998f-23fecb5de199+3:18882:x1876405552016640:12345-0@lo:104: Request processed in 120us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480289.085896:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789480289.086038:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480289.086059:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.086067:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480289.086071:0:18855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.086079:0:18855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480289.086087:0:18855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480289.086092:0:18855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789480289.086125:0:18855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.086131:0:18855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480289.086152:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.086159:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fec86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fec8d expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480289.086181:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480289.086183:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480289.086184:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480289.086202:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480289.086213:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552016768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480289.086250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480289.086343:0:18882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18882:1876405552016640:0@lo:104: 00010000:00010000:2.0:1789480289.086371:0:18882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480289.086778:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016768 00000100:00100000:0.0:1789480289.086784:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016768 00010000:00010000:0.0:1789480289.086805:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fec86 expref: 13 pid: 18860 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480289.086829:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480289.086837:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+13:3301:x1876405552016768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480289.086847:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480289.086860:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fec86 expref: 13 pid: 18860 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086872:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fec86 expref: 13 pid: 18860 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086887:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2600/0xbb972366037fec8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fec86 expref: 13 pid: 18860 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086902:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086910:0:18851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789480289.086925:0:18851:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003302404s 00010000:00010000:0.0:1789480289.086930:0:18851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086937:0:18851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086944:0:18851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086950:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086956:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480289.086961:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086981:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.086997:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.087007:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480289.087046:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+12:3301:x1876405552016768:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480289.087053:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480289.087083:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552016768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480289.087100:0:18882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.087108:0:18882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.087114:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2187647800/0xbb972366037fecbe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480289.100159:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+11:18848:x1876405552016512:12345-0@lo:253:mount.lustre.0 Request processed in 100302us (100447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480289.100175:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789480289.100323:0:18848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:18848:1876405552016512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480289.100338:0:18848:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789480289.100342:0:18848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480289.100344:0:18848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480289.100345:0:18848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480289.100346:0:18848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480289.100348:0:18848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480289.100349:0:18848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480289.100351:0:18848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480289.100352:0:18848:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480289.100362:0:18848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480289.100364:0:18848:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789480289.100378:0:18848:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789480289.118213:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789480289.118802:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789480289.119093:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480289.129870:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789480289.133837:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480289.134045:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789480289.140122:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480289.140342:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789480289.140863:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480289.141693:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789480289.141977:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480289.142159:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789480289.183134:0:18848:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:1.0:1789480289.183671:0:18848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789480289.184023:0:18906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789480289.184086:0:18906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1789480289.186384:0:18905:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:2.0:1789480289.186392:0:18905:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:00080000:1.0:1789480289.187921:0:18906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789480289.188092:0:18906:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789480289.188096:0:18906:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789480289.192086:0:18848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789480289.192471:0:18848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789480289.193155:0:18848:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789480289.193164:0:18848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789480289.193523:0:18848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789480289.195121:0:18848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789480289.196758:0:18848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789480289.196816:0:18848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789480289.197581:0:18848:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789480289.198851:0:18848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1789480289.207029:0:18848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789480289.240700:0:18848:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789480289.240737:0:18848:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa28701c4b988 00100000:10000000:0.0:1789480289.240968:0:18848:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789480289.241693:0:18848:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789480289.241710:0:18848:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789480289.241725:0:18848:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789480289.241761:0:18848:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789480289.562885:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789480289.587000:0:18863:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789480289.587013:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d218785b000 from 9 10000000:01000000:3.0:1789480289.587019:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789480289.587086:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480289.587102:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480289.587116:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480289.587150:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552016896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480289.589717:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480289.589832:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480289.591153:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552016896 00000100:00100000:0.0:1789480289.591164:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552016896 00000100:00100000:0.0:1789480289.591242:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789480289.591253:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+11:18863:x1876405552016896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480289.591268:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480289.591310:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fecc5 expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.591336:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fecc5 expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.591347:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fecc5 expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480289.591355:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6a00, rc 0) 00000100:00100000:0.0:1789480289.591444:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552016896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480289.591451:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789480289.592251:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552016896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480289.592273:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480289.592317:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480289.592394:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552017024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789480289.592441:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480289.592570:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789480289.593615:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552017024 00000100:00100000:1.0:1789480289.593627:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552017024 00000100:00100000:1.0:1789480289.593820:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789480289.593831:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552017024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789480289.593851:0:18861:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789480289.593886:0:18861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789480289.593889:0:18861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789480289.594011:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552017024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480289.594020:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480289.594124:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552017024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789480289.595618:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789480289.595631:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480289.595656:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480290.012594:0:18900:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789480290.012608:0:18900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480290.013183:0:18900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789480290.013196:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789480290.589102:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480291.034809:0:18900:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789480291.034822:0:18900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480291.036234:0:18900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1789480291.036420:0:18900:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480291.036463:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1789480291.610449:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480292.634411:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789480293.507466:0:19149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789480293.661748:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480294.234964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480294.234972:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480294.234984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480294.234986:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480294.234989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789480294.234993:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789480294.234997:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d22bb0da000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480294.235013:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d22bb0da000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480294.235035:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4bb7100 x1876405552017280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480294.235072:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480294.235085:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552017152:0@lo:400:kworker.0 00000100:00100000:0.0:1789480294.235162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480294.235223:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552017152 00000100:00100000:0.0:1789480294.235230:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552017152 00000100:00100000:0.0:1789480294.235271:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480294.235305:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:3300:x1876405552017152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480294.235356:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:3300:x1876405552017152:12345-0@lo:400:kworker.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480294.235363:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480294.235400:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405552017280:0@lo:38:kworker.0 00000100:00100000:0.0:1789480294.235426:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480294.235462:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552017280 00000100:00100000:0.0:1789480294.235466:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552017280 00000100:00100000:0.0:1789480294.235486:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480294.235492:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405552017280:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789480294.235512:0:18868:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1789480294.235561:0:18868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbb972366037fecd3 00000004:00100000:0.0:1789480294.235576:0:18868:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789480294.235861:0:18868:0:(import.c:65:import_set_state_nolock()) ffff8d22bfd4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480294.235903:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876405552017280:12345-0@lo:38:kworker.0 Request processed in 410us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480294.235910:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789480294.235948:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22a4bb7100 x1876405552017280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480294.235964:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789480294.235972:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789480294.235976:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789480294.235986:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb0da000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789480294.235992:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405552017280:0@lo:38:kworker.0 00000100:00100000:0.0:1789480294.236020:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552017152:0@lo:400:kworker.0 00010000:00010000:2.0:1789480294.685278:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480295.706591:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480296.731504:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789480297.122573:0:19300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda72039a0 20000000:00000080:2.0:1789480297.122598:0:19300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22b920a800 uarg=0000000000000000 20000000:01000000:2.0:1789480297.122635:0:19300:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789480297.122643:0:19300:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789480297.122648:0:19300:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789480297.123813:0:19301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789480297.124062:0:19300:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789480297.131055:0:19300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789480297.131257:0:19300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.131278:0:19300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fec94 expref: 11 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.131711:0:19300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.131756:0:19300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fec94 expref: 11 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.131774:0:19300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fec94 expref: 11 pid: 18860 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480297.131805:0:19300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19300:1876405552017408:0@lo:104: 00000100:00100000:2.0:1789480297.131868:0:19300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480297.131987:0:19300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789480297.132260:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552017408 00000100:00100000:0.0:1789480297.132268:0:18850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552017408 00000100:00100000:0.0:1789480297.133612:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480297.133627:0:18850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:19300:x1876405552017408:12345-0@lo:104: 00010000:00010000:0.0:1789480297.133643:0:18850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480297.133781:0:18850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480297.133787:0:18850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:19300:x1876405552017408:12345-0@lo:104: Request processed in 165us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480297.133793:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789480297.133848:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480297.133855:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480297.133863:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d600 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480297.133878:0:18854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480297.133886:0:18854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480297.133894:0:18854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480297.133899:0:18854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480297.133953:0:18854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480297.133969:0:18854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480297.133997:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480297.134004:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d600/0xbb972366037fec94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fec9b expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480297.134024:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480297.134026:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480297.134027:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480297.134051:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480297.134061:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2016df8a-d509-4535-998f-23fecb5de199:3299:1876405552017536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480297.134111:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480297.134456:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552017536 00000100:00100000:1.0:1789480297.134463:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552017536 00010000:00010000:1.0:1789480297.134496:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fec94 expref: 12 pid: 18860 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480297.134528:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480297.134535:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+12:3299:x1876405552017536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480297.134555:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480297.134561:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fec94 expref: 12 pid: 18860 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134574:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fec94 expref: 12 pid: 18860 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134591:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134599:0:18851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134616:0:18851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134624:0:18851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134630:0:18851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134637:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134642:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480297.134646:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134653:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134673:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480297.134683:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480297.134726:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+12:3299:x1876405552017536:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480297.134734:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480297.134774:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2016df8a-d509-4535-998f-23fecb5de199:3299:1876405552017536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480297.135248:0:19300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39d200/0xbb972366037fec9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fec94 expref: 11 pid: 18860 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480297.135264:0:19300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19300:1876405552017408:0@lo:104: 00010000:00010000:2.0:1789480297.135393:0:19300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.135406:0:19300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.135413:0:19300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480297.135420:0:19300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2187646600/0xbb972366037fecda lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480297.759864:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480298.330495:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480288/real 1789480288] req@ffff8d22a4bb6d80 x1876405552014592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480298.330526:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d22a4bb6d80 x1876405552014592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480298 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480298.330536:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480288/real 1789480288] req@ffff8d22a4bb7480 x1876405552014464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480298.330550:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d22a4bb7480 x1876405552014464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480298 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480298.330570:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480298.330597:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480298.330609:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552014592:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789480298.330615:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb3bc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480298.330621:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480298.330624:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552014464:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789480298.330717:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2016df8a-d509-4535-998f-23fecb5de199:3299:1876405552017664:0@lo:400:kworker.0 00000100:00100000:3.0:1789480298.330796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480298.330854:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552017664 00000100:00100000:0.0:1789480298.330863:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552017664 00000100:00080000:1.0:1789480298.330883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480298.330888:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789480298.330890:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d22bb3bc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480298.330895:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1789480298.330900:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1789480298.330906:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789480298.330909:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d22bb3bc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480298.330915:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+11:3299:x1876405552017664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480298.330931:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd786300 x1876405552017792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480298.330944:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480298.330947:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789480298.330949:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480298.330952:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1789480298.330954:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1789480298.331045:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+11:3299:x1876405552017664:12345-0@lo:400:kworker.0 Request processed in 129us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480298.331053:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789480298.331118:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d229c447000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480298.331135:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd785f80 x1876405552017920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480298.331311:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552017792:0@lo:8:kworker.0 00000400:00000100:1.0:1789480298.331352:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405552017792 offset 0 length 520: 4 00000100:00100000:1.0:1789480298.331371:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552017920:0@lo:8:kworker.0 00000400:00000100:1.0:1789480298.331389:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405552017920 offset 0 length 520: 4 00000100:00100000:0.0:1789480298.331444:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552018048:0@lo:400:kworker.0 00000100:00100000:0.0:1789480298.331496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480298.334852:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018048 00000100:00100000:0.0:1789480298.334869:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018048 00000100:00100000:0.0:1789480298.334925:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480298.334935:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552018048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480298.335028:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552018048:12345-0@lo:400:kworker.0 Request processed in 95us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480298.335036:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789480298.335086:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22bd784e00 x1876405552018048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480298.335101:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552018048:0@lo:400:kworker.0 00000100:00100000:3.0:1789480298.335507:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2016df8a-d509-4535-998f-23fecb5de199:3299:1876405552017664:0@lo:400:kworker.0 00010000:00010000:3.0:1789480298.779000:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789480298.970951:0:18863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480298.970959:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d218785b000 from 10 10000000:01000000:1.0:1789480298.970965:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480298.971012:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480298.971025:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480298.971036:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480298.971062:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552018176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480298.971128:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480298.971179:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a1251d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480298.977844:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018176 00000100:00100000:0.0:1789480298.977860:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018176 00000100:00100000:0.0:1789480298.977925:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789480298.977935:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+11:18863:x1876405552018176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480298.977952:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480298.977974:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fece1 expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480298.978002:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fece1 expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480298.978015:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fece1 expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480298.978023:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6800, rc 0) 00000100:00100000:0.0:1789480298.978105:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552018176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (6976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480298.978113:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789480298.978261:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552018176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480298.978304:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480298.978314:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480298.978383:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552018304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480298.978419:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480298.978448:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480298.979352:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018304 00000100:00100000:0.0:1789480298.979360:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018304 00000100:00100000:0.0:1789480298.979397:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789480298.979405:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552018304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480298.979688:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552018304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480298.979694:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480298.980361:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552018304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480298.980401:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552018432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480298.980443:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480298.980481:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480298.980538:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018432 00000100:00100000:2.0:1789480298.980543:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018432 00000100:00100000:2.0:1789480298.980582:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480298.980589:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552018432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480298.980740:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:18863:x1876405552018432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480298.980747:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480298.980787:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552018432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480298.981434:0:19366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789480298.981507:0:18863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789480298.981528:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480298.981537:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480298.981548:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480299.802472:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480300.829662:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480301.276816:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789480301.852693:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480302.875166:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789480303.450936:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480303.450943:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480303.450946:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480303.450949:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789480303.450980:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480303.450996:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552018560:0@lo:400:kworker.0 00000100:00100000:2.0:1789480303.451064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.451117:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018560 00000100:00100000:2.0:1789480303.451124:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018560 00000100:00100000:2.0:1789480303.451169:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789480303.451179:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:3300:x1876405552018560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480303.451231:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+12:3300:x1876405552018560:12345-0@lo:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480303.451237:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789480303.451323:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552018560:0@lo:400:kworker.0 00000100:00100000:3.0:1789480303.451544:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480303.451555:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405552018688:0@lo:400:kworker.0 00000100:00100000:3.0:1789480303.451595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.451896:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018688 00000100:00100000:2.0:1789480303.451909:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018688 00000100:00100000:2.0:1789480303.451943:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480303.451951:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405552018688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480303.451992:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405552018688:12345-0@lo:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480303.451999:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789480303.452034:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2187731180 x1876405552018688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480303.452045:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405552018688:0@lo:400:kworker.0 00000020:01000004:2.0:1789480303.544349:0:19550:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789480303.544354:0:19550:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789480303.544492:0:19550:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d229c509800 00000020:01000004:2.0:1789480303.544508:0:19550:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789480303.544520:0:19550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789480303.544534:0:19550:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d22a4accd40) 00000020:00000080:2.0:1789480303.544551:0:19550:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789480303.563166:0:19550:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789480303.563588:0:19550:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789480303.564656:0:19550:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789480303.564928:0:19550:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789480303.565412:0:19550:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1789480303.565917:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789480303.566105:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789480303.566205:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1789480303.567535:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 74: rc = 0 00100000:10000000:2.0:1789480303.567802:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 74: rc = 0 00100000:10000000:2.0:1789480303.568140:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 74: rc = 0 00100000:10000000:2.0:1789480303.569726:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 74: rc = 0 00100000:10000000:2.0:1789480303.570061:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 74: rc = 0 00100000:10000000:2.0:1789480303.570542:0:19550:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 74: rc = 0 00000020:00000080:2.0:1789480303.571844:0:19550:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789480303.571856:0:19550:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789480303.571867:0:19550:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb972366037fecf6 00000020:01000004:2.0:1789480303.571877:0:19550:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789480303.571900:0:19550:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789480303.571904:0:19550:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789480303.571910:0:19550:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789480303.571915:0:19550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789480303.571926:0:19550:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d22a4ac99c0) 00000020:00000080:2.0:1789480303.571936:0:19550:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789480303.573483:0:19550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480303.573665:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789480303.573672:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789480303.576829:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789480303.576843:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789480303.580570:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789480303.580586:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789480303.584701:0:19550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480303.584898:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789480303.584905:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789480303.586575:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789480303.586585:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789480303.614914:0:19550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480303.615212:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789480303.615219:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789480303.617091:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789480303.617106:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789480303.618182:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789480303.618191:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789480303.625883:0:19550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789480303.627626:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789480303.627651:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789480303.633481:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789480303.633497:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789480303.690924:0:19550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480303.691137:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789480303.691152:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789480303.692900:0:19550:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789480303.692913:0:19550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789480303.693483:0:19550:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789480303.693507:0:19550:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789480303.693514:0:19550:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789480303.710139:0:19550:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789480303.710180:0:19550:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789480303.710184:0:19550:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789480303.710186:0:19550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480303.710187:0:19550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480303.710189:0:19550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480303.710190:0:19550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480303.710191:0:19550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480303.710192:0:19550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480303.710194:0:19550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480303.710200:0:19550:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789480303.710204:0:19550:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789480303.710206:0:19550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789480303.710208:0:19550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480303.710209:0:19550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480303.710209:0:19550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480303.710210:0:19550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480303.710211:0:19550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480303.710212:0:19550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480303.710213:0:19550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480303.710214:0:19550:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789480303.710240:0:19550:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789480303.710259:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552018816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480303.712698:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480303.712842:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a0297f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480303.720227:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018816 00000100:00100000:3.0:1789480303.720243:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018816 00000100:00100000:3.0:1789480303.720611:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789480303.720623:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:19550:x1876405552018816:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789480303.720661:0:18860:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789480303.720664:0:18860:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789480303.720668:0:18860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789480303.759910:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:19550:x1876405552018816:12345-0@lo:253:mount.lustre.0 Request processed in 39282us (47210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.759924:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480303.760066:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552018816:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789480303.760081:0:19550:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789480303.760085:0:19550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789480303.760086:0:19550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480303.760089:0:19550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480303.760090:0:19550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480303.760092:0:19550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480303.760093:0:19550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480303.760095:0:19550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480303.760096:0:19550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480303.760097:0:19550:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789480303.760118:0:19550:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d229c509800 from lustre-OST0000 10000000:01000000:1.0:1789480303.760144:0:19550:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789480303.760147:0:19550:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789480303.760154:0:19550:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d21852a8000 local copy 00010000:00010000:1.0:1789480303.760165:0:19550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480303.760651:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552018944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480303.760706:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480303.760797:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a02970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480303.760846:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552018944 00000100:00100000:2.0:1789480303.760853:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552018944 00000100:00100000:2.0:1789480303.760953:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789480303.760972:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:19550:x1876405552018944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480303.761195:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+12:19550:x1876405552018944:12345-0@lo:501:mount.lustre.0 Request processed in 225us (487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789480303.761202:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480303.761648:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552018944:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789480303.761666:0:19550:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789480303.761843:0:19550:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789480303.761851:0:19550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.761862:0:19550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480303.761886:0:19550:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d229c509800 10000000:01000000:1.0:1789480303.761891:0:19550:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789480303.761896:0:19550:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d21852a8000 10000000:01000000:1.0:1789480303.761899:0:19550:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789480303.761902:0:19550:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d21852a8000 from 1 10000000:01000000:1.0:1789480303.761906:0:19550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789480303.761935:0:19550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.762009:0:19550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.762020:0:19550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480303.762036:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480303.762072:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480303.762115:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a02970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480303.762221:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019072 00000100:00100000:0.0:1789480303.762226:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019072 00000100:00100000:0.0:1789480303.762272:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789480303.762683:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+12:19550:x1876405552019072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480303.762698:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480303.762714:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fed0b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fed04 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.762738:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fed0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fed04 expref: 13 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.762747:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fed0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed04 expref: 13 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.762756:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6000, rc 0) 00000100:00100000:0.0:1789480303.762795:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+13:19550:x1876405552019072:12345-0@lo:101:mount.lustre.0 Request processed in 517us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.762802:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789480303.762898:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480303.762914:0:19550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed0b expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480303.762923:0:19550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fed0b expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480303.762955:0:19550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789480303.762972:0:19550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed0b expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480303.762980:0:19550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c400/0xbb972366037fed04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed0b expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480303.762987:0:19550:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789480303.762992:0:19550:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789480303.762996:0:19550:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789480303.762999:0:19550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789480303.763016:0:19550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480303.763038:0:19550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480303.763046:0:19550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480303.763061:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480303.763090:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480303.763111:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480303.763222:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019200 00000100:00100000:0.0:1789480303.763226:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019200 00000100:00100000:0.0:1789480303.763246:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789480303.763252:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+13:19550:x1876405552019200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480303.763258:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480303.763271:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7c00/0xbb972366037fed19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fed12 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.763390:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7c00/0xbb972366037fed19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fed12 expref: 14 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.763400:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7c00/0xbb972366037fed19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed12 expref: 14 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.763407:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7c00, rc 0) 00000100:00100000:0.0:1789480303.763498:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019200:12345-0@lo:101:mount.lustre.0 Request processed in 246us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.763504:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789480303.763672:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480303.763683:0:19550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed19 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480303.763690:0:19550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fed19 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480303.765196:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789480303.766752:0:19550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480303.767050:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789480303.767099:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789480303.767132:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789480303.767180:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789480303.767217:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789480303.767248:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789480303.767344:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789480303.767395:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789480303.767437:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789480303.767493:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789480303.767537:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789480303.767581:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789480303.767642:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789480303.767650:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789480303.768186:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480303.768254:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.770579:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.773536:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019328 00000100:00100000:1.0:1789480303.773553:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019328 00000100:00100000:1.0:1789480303.773616:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789480303.773627:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480303.775577:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019328:12345-0@lo:501:mount.lustre.0 Request processed in 1945us (7316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.775589:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789480303.780194:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480303.780274:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480303.782053:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.782115:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480303.782326:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019456 00000100:00100000:0.0:1789480303.782334:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019456 00000100:00100000:0.0:1789480303.782404:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789480303.782415:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480303.783133:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019456:12345-0@lo:503:mount.lustre.0 Request processed in 718us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.783141:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789480303.783522:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480303.788868:0:19550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480303.789053:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480303.789135:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.789259:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.789870:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019584 00000100:00100000:1.0:1789480303.789879:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019584 00000100:00100000:1.0:1789480303.790066:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789480303.790077:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480303.790404:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019584:12345-0@lo:502:mount.lustre.0 Request processed in 329us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.790414:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789480303.790523:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480303.790806:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789480303.790863:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789480303.790905:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789480303.790975:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789480303.791018:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789480303.791077:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789480303.791130:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789480303.791168:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789480303.791219:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789480303.791272:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789480303.791339:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789480303.791405:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789480303.791442:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480303.791492:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.792493:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480303.792612:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019712 00000100:00100000:0.0:1789480303.792619:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019712 00000100:00100000:0.0:1789480303.792661:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789480303.792669:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480303.793059:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019712:12345-0@lo:502:mount.lustre.0 Request processed in 391us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.793066:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789480303.793175:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480303.793273:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789480303.793317:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789480303.798501:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789480303.798514:0:19564:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789480303.798521:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.798524:0:19564:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789480303.798531:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480303.798546:0:19564:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d229c7d99c0) 00000020:00000080:1.0:1789480303.798570:0:19564:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789480303.798581:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789480303.798660:0:19564:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d229c509800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789480303.798668:0:19564:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789480303.798680:0:19564:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb972366037fed27 00010000:00010000:1.0:1789480303.804030:0:19564:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789480303.804631:0:19564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:1.0:1789480303.807340:0:19564:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789480303.809007:0:19564:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789480303.809020:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480303.809026:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.809028:0:19564:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789480303.809031:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789480303.809034:0:19564:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789480303.809035:0:19564:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480303.809037:0:19564:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480303.809038:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789480303.809040:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.809041:0:19564:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789480303.809043:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480303.809046:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.809047:0:19564:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789480303.809049:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789480303.809050:0:19564:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789480303.809052:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480303.809054:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.809055:0:19564:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789480303.809058:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480303.809060:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.809062:0:19564:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789480303.809064:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789480303.809120:0:19564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480303.809123:0:19564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480303.809125:0:19564:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789480303.809128:0:19564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1789480303.809635:0:19550:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789480303.809667:0:19550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789480303.809682:0:19550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed19 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480303.809696:0:19550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fed12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed19 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480303.809704:0:19550:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d229c509800 from 1 10000000:01000000:2.0:1789480303.809707:0:19550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789480303.809743:0:19550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480303.809752:0:19550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480303.809762:0:19550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480303.809787:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480303.809862:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.809905:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.809967:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019840 00000100:00100000:1.0:1789480303.809975:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019840 00000100:00100000:1.0:1789480303.810024:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789480303.810033:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+14:19550:x1876405552019840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480303.810046:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480303.810059:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fed2e expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.810093:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fed2e expref: 15 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.810105:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed2e expref: 15 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.810114:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d600, rc 0) 00000100:00100000:1.0:1789480303.810157:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552019840:12345-0@lo:101:mount.lustre.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.810164:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789480303.810337:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480303.810352:0:19550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480303.810373:0:19550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480303.810870:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1789480303.811191:0:19550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480303.811489:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789480303.811538:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789480303.811589:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789480303.811630:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789480303.811687:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789480303.811743:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789480303.811781:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789480303.811814:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789480303.811882:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789480303.811890:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1789480303.811964:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480303.812016:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.812051:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.812564:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552019968 00000100:00100000:1.0:1789480303.812571:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552019968 00000100:00100000:1.0:1789480303.812618:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789480303.812627:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552019968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480303.812824:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552019968:12345-0@lo:501:mount.lustre.0 Request processed in 198us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.812832:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480303.813047:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552019968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480303.813083:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480303.813124:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.813199:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.816180:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020096 00000100:00100000:1.0:1789480303.816193:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020096 00000100:00100000:1.0:1789480303.816251:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480303.816261:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480303.816694:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020096:12345-0@lo:503:mount.lustre.0 Request processed in 433us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.816702:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480303.816836:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789480303.817872:0:19550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789480303.818597:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480303.818671:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480303.818755:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.823651:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020224 00000100:00100000:1.0:1789480303.823669:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020224 00000100:00100000:1.0:1789480303.823728:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480303.823738:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480303.824027:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020224:12345-0@lo:502:mount.lustre.0 Request processed in 289us (5354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.824035:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789480303.824157:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789480303.824507:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789480303.824565:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789480303.824637:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789480303.824677:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789480303.824709:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789480303.824755:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789480303.824792:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789480303.824828:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1789480303.824865:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480303.824910:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480303.824946:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.825248:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020352 00000100:00100000:1.0:1789480303.825254:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020352 00000100:00100000:1.0:1789480303.825551:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789480303.825561:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480303.825741:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020352:12345-0@lo:502:mount.lustre.0 Request processed in 181us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.825748:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789480303.825861:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480303.826002:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789480303.826014:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789480303.836409:0:19568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480303.836433:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480303.836435:0:19568:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789480303.836443:0:19568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d229c509800 00000020:00000080:3.0:1789480303.836445:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480303.836452:0:19568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480303.836455:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480303.836456:0:19568:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789480303.836458:0:19568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480303.836461:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480303.836462:0:19568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789480303.836465:0:19568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d229c509800 00000020:00000080:3.0:1789480303.836467:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480303.836522:0:19568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480303.836526:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480303.836527:0:19568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789480303.836530:0:19568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480303.836532:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480303.836533:0:19568:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480303.836537:0:19568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d229c509800 00000020:00000080:3.0:1789480303.836539:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480303.836577:0:19568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480303.836580:0:19568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480303.836582:0:19568:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789480303.836585:0:19568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1789480303.838037:0:19550:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789480303.838070:0:19550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480303.838090:0:19550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.838103:0:19550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480303.838147:0:19550:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789480303.838149:0:19550:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d229c509800 10000000:01000000:1.0:1789480303.838152:0:19550:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d229c509800 10000000:01000000:1.0:1789480303.838156:0:19550:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480303.838161:0:19550:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d229c509800 from 1 10000000:01000000:1.0:1789480303.838163:0:19550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789480303.838196:0:19550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.838215:0:19550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480303.838226:0:19550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480303.838248:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480303.838323:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480303.838369:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a02970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480303.838767:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020480 00000100:00100000:0.0:1789480303.838774:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020480 00000100:00100000:0.0:1789480303.838819:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789480303.838827:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552020480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480303.838838:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480303.838850:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6600/0xbb972366037fed43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fed3c expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.838872:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6600/0xbb972366037fed43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fed3c expref: 16 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.838883:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6600/0xbb972366037fed43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed3c expref: 16 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.838899:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6600, rc 0) 00000100:00100000:0.0:1789480303.839214:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020480:12345-0@lo:101:mount.lustre.0 Request processed in 387us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.839221:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789480303.847250:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480303.847296:0:19550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed43 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480303.847323:0:19550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fed43 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480303.850313:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1789480303.852224:0:19550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480303.855326:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789480303.855441:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789480303.855480:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789480303.855531:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789480303.855572:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789480303.855639:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789480303.855678:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789480303.855712:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789480303.857914:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789480303.858562:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789480303.858601:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789480303.858656:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789480303.858695:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789480303.858732:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789480303.861619:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789480303.861665:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789480303.861703:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789480303.861778:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789480303.861818:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789480303.861856:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789480303.861905:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789480303.863382:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789480303.864079:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789480303.864146:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789480303.864178:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1789480303.864206:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1789480303.864261:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1789480303.864324:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1789480303.864376:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1789480303.866635:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1789480303.866730:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1789480303.866768:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1789480303.866804:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1789480303.866911:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1789480303.870233:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1789480303.870395:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1789480303.870440:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1789480303.870479:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1789480303.870533:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1789480303.870572:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1789480303.870676:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1789480303.870684:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1789480303.870788:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480303.870853:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480303.870901:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.871545:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020608 00000100:00100000:1.0:1789480303.871553:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020608 00000100:00100000:1.0:1789480303.871605:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789480303.871615:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480303.871868:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020608:12345-0@lo:501:mount.lustre.0 Request processed in 255us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.871876:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789480303.872234:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480303.872270:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480303.872710:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480303.872791:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.884008:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020736 00000100:00100000:1.0:1789480303.884023:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020736 00000100:00100000:3.0:1789480303.891030:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789480303.891055:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480303.891308:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020736:12345-0@lo:503:mount.lustre.0 Request processed in 264us (18598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480303.895641:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480303.897860:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:2.0:1789480303.898854:0:19550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480303.899026:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480303.899108:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.899209:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480303.899257:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020864 00000100:00100000:3.0:1789480303.899264:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020864 00000100:00100000:3.0:1789480303.899605:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789480303.899615:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480303.899882:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020864:12345-0@lo:502:mount.lustre.0 Request processed in 268us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480303.899890:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1789480303.900039:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480303.900069:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480303.900385:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789480303.900454:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789480303.900490:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789480303.900542:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789480303.900583:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789480303.900634:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789480303.900673:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789480303.900708:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789480303.900774:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789480303.900810:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789480303.900839:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789480303.900886:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789480303.900927:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789480303.901125:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789480303.901179:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789480303.901215:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789480303.901247:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789480303.901329:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789480303.901387:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789480303.901511:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789480303.901567:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789480303.901606:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789480303.901645:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789480303.901692:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789480303.901748:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1789480303.901788:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1789480303.901839:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1789480303.901877:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1789480303.901913:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1789480303.902167:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1789480303.902212:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1789480303.902249:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1789480303.905549:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1789480303.905691:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1789480303.905734:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1789480303.905788:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1789480303.905827:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1789480303.905865:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1789480303.905916:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1789480303.906129:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1789480303.906187:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480303.906340:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.906400:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480303.906571:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552020992 00000100:00100000:3.0:1789480303.906580:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552020992 00000100:00100000:3.0:1789480303.906638:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789480303.906648:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480303.906919:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552020992:12345-0@lo:502:mount.lustre.0 Request processed in 272us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480303.906928:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789480303.908573:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552020992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480303.909139:0:19550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1789480303.909154:0:19550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789480303.912806:0:19573:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789480303.912827:0:19573:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d229c723380) 00000020:00000080:2.0:1789480303.912850:0:19573:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789480303.912927:0:19573:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d229c509800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789480303.912931:0:19573:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d229c509800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789480303.913025:0:19573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d229c509800 3 00010000:00080000:2.0:1789480303.913074:0:19573:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22828ca000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1789480303.916759:0:19573:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789480303.917049:0:19573:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789480303.917089:0:19573:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789480303.917103:0:19573:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbb972366037fed51 00000100:00080000:2.0:1789480303.917115:0:19573:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789480303.917127:0:19573:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d22828ca000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480303.917171:0:19573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187733480 x1876405552021120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480303.917191:0:19573:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789480303.917307:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405552021120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480303.917387:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480303.918089:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021120 00000100:00100000:1.0:1789480303.918099:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021120 00000100:00100000:1.0:1789480303.918141:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480303.918149:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405552021120:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789480303.918199:0:18868:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:1.0:1789480303.918234:0:18868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbb972366037fed58 00000004:00100000:1.0:1789480303.918257:0:18868:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789480303.918323:0:18868:0:(import.c:65:import_set_state_nolock()) ffff8d2283301800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480303.918405:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876405552021120:12345-0@lo:38:llog_process_th.0 Request processed in 254us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480303.918413:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789480303.918643:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2187733480 x1876405552021120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480303.918654:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789480303.918662:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789480303.918669:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789480303.918673:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789480303.918675:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22828ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789480303.918681:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405552021120:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789480303.923316:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480303.923327:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480303.923330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480303.923334:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789480303.928045:0:19573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:2.0:1789480303.928139:0:19550:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789480303.928167:0:19550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789480303.928185:0:19550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed43 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480303.928196:0:19550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d200/0xbb972366037fed3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed43 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789480303.928243:0:19550:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789480303.928245:0:19550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789480303.928247:0:19550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480303.928248:0:19550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480303.928249:0:19550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480303.928250:0:19550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480303.928252:0:19550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480303.928254:0:19550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480303.928255:0:19550:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789480303.928259:0:19550:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789480303.928261:0:19550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789480303.928262:0:19550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789480303.928268:0:19550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480303.928269:0:19550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480303.928270:0:19550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480303.928271:0:19550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480303.928272:0:19550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480303.928273:0:19550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480303.928274:0:19550:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789480303.928516:0:19550:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789480303.928536:0:19550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552021248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789480303.928603:0:19550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480303.928687:0:19550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ab18b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480303.941087:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021248 00000100:00100000:1.0:1789480303.941100:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021248 00000100:00100000:2.0:1789480303.942218:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789480303.942231:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:19550:x1876405552021248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480303.942521:0:18858:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789480303.942537:0:18858:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789480303.978776:0:18858:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789480303.978790:0:18858:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789480303.980146:0:18882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789480303.980154:0:18882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789480303.980178:0:18882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.980199:0:18882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fecc5 expref: 16 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.980208:0:18882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.980250:0:18882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fecc5 expref: 16 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.980267:0:18882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fecc5 expref: 16 pid: 18858 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480303.980858:0:18882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18882:1876405552021376:0@lo:104: 00000100:00100000:0.0:1789480303.980927:0:18882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480303.980985:0:18882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c713b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480303.981259:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021376 00000100:00100000:2.0:1789480303.981268:0:18850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021376 00000100:00100000:2.0:1789480303.981844:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480303.981854:0:18850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:18882:x1876405552021376:12345-0@lo:104: 00010000:00010000:2.0:1789480303.981870:0:18850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480303.981946:0:18850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789480303.981953:0:18850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:18882:x1876405552021376:12345-0@lo:104: Request processed in 101us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480303.981961:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480303.982140:0:18882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18882:1876405552021376:0@lo:104: 00010000:00010000:0.0:1789480303.982164:0:18882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982195:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480303.982201:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982208:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d3800 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789480303.982212:0:18854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982221:0:18854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480303.982228:0:18854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480303.982233:0:18854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789480303.982331:0:18854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982339:0:18854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480303.982371:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982379:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22813d3800/0xbb972366037fecc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037feccc expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982398:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480303.982400:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480303.982402:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480303.982425:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480303.982443:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552021504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480303.982479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480303.982522:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021504 00000100:00100000:0.0:1789480303.982527:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021504 00010000:00010000:0.0:1789480303.982546:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fecc5 expref: 17 pid: 18858 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480303.982574:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480303.982581:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+17:3298:x1876405552021504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480303.982592:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480303.982597:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fecc5 expref: 17 pid: 18858 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982609:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fecc5 expref: 17 pid: 18858 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982623:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037feccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fecc5 expref: 17 pid: 18858 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982636:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982644:0:18851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789480303.982659:0:18851:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003302404s 00010000:00010000:0.0:1789480303.982663:0:18851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982670:0:18851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982688:0:18851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982694:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982699:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480303.982703:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982709:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982721:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982729:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480303.982768:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+16:3298:x1876405552021504:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480303.982775:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789480303.982796:0:18882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982802:0:18882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480303.982808:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7a00/0xbb972366037fed5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480303.982829:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552021504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480303.997608:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+15:19550:x1876405552021248:12345-0@lo:253:mount.lustre.0 Request processed in 55371us (68995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480303.997623:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789480303.997765:0:19550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:19550:1876405552021248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789480303.997782:0:19550:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789480303.997785:0:19550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789480303.997787:0:19550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480303.997789:0:19550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480303.997790:0:19550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480303.997791:0:19550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480303.997793:0:19550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480303.997794:0:19550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480303.997796:0:19550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480303.997798:0:19550:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789480303.997812:0:19550:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789480303.998202:0:19550:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480304.001729:0:19550:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480304.002073:0:19550:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480304.002227:0:19550:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480304.002547:0:19550:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480304.002767:0:19550:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789480304.005229:0:19550:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1789480304.116619:0:19550:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789480304.116628:0:19550:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789480304.116663:0:19550:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789480304.116728:0:19550:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789480304.116756:0:19550:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789480304.116786:0:19550:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789480304.924614:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789480305.114931:0:18863:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789480305.114940:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d218785b000 from 10 10000000:01000000:0.0:1789480305.114945:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480305.114994:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.115005:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.115016:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480305.115042:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552021632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480305.115200:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480305.115252:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c713d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480305.115322:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021632 00000100:00100000:2.0:1789480305.115346:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021632 00000100:00100000:0.0:1789480305.115521:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789480305.115539:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+15:18863:x1876405552021632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480305.115554:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480305.115569:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fed66 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.115602:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fed66 expref: 16 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.115612:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed66 expref: 16 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.115621:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7e00, rc 0) 00000100:00100000:0.0:1789480305.115672:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:18863:x1876405552021632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480305.115693:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789480305.115756:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552021632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480305.115772:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.115781:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480305.115839:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552021760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480305.115878:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480305.115922:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c713d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480305.116045:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021760 00000100:00100000:2.0:1789480305.116053:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021760 00000100:00100000:2.0:1789480305.116107:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789480305.116116:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:18863:x1876405552021760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789480305.116354:0:18858:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789480305.116375:0:18858:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789480305.116379:0:18858:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789480305.116468:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:18863:x1876405552021760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 353us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480305.116480:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789480305.116903:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552021760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480305.116968:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480305.116977:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.116985:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480305.947332:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480306.971546:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480307.997715:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480309.018357:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480309.094451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480309.094458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480309.094461:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480309.094464:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789480309.094529:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552021888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.094605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480309.094652:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480309.094659:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552022016:0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.094683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480309.094713:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480309.094720:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552022144:0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.094744:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480309.094770:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552021888 00000100:00100000:3.0:1789480309.094777:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552021888 00000100:00100000:3.0:1789480309.094814:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789480309.094822:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:3300:x1876405552021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.094866:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:3300:x1876405552021888:12345-0@lo:400:kworker.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480309.094874:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789480309.094906:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022016 00000100:00100000:3.0:1789480309.094910:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022016 00000100:00100000:3.0:1789480309.094929:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022144 00000100:00100000:3.0:1789480309.094931:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022144 00000100:00100000:3.0:1789480309.094954:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480309.094960:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552022016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.094993:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552022016:12345-0@lo:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480309.094999:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480309.095010:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480309.095016:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405552022144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.095055:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405552022144:12345-0@lo:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480309.095061:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789480309.095096:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a485d180 x1876405552022016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480309.095110:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552022016:0@lo:400:kworker.0 00000100:00100000:3.0:1789480309.095118:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552021888:0@lo:400:kworker.0 00000100:00080000:3.0:1789480309.095150:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789480309.095162:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a485ed80 x1876405552022144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480309.095172:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552022144:0@lo:400:kworker.0 00010000:00010000:2.0:1789480310.046390:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480311.067648:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480311.527340:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789480312.076769:0:19916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789480312.092207:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.114585:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480313.115376:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480298/real 1789480298] req@ffff8d22bd786300 x1876405552017792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480313 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480313.115411:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d22bd786300 x1876405552017792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480313 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480313.115422:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480298/real 1789480298] req@ffff8d22bd785f80 x1876405552017920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480313 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480313.115433:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d22bd785f80 x1876405552017920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480313 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480313.115454:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb3bc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480313.115486:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789480313.115491:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552017792:0@lo:8:kworker.0 00000100:00080000:1.0:1789480313.115497:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480313.115501:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789480313.115504:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552017920:0@lo:8:kworker.0 00000100:00080000:0.0:1789480313.115651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480313.115655:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789480313.115672:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d22bb3bc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480313.115677:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 591 00000100:00080000:0.0:1789480313.115682:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789480313.115693:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d22bb3bc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480313.115714:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4bb4700 x1876405552022400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480313.115729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480313.115732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789480313.115734:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480313.115737:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 591 00000100:00080000:0.0:1789480313.115739:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789480313.115744:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d229c447000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480313.115753:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4bb4a80 x1876405552022528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480313.115823:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480313.115834:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552022272:0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.115898:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480313.115998:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552022656:0@lo:400:kworker.0 00000100:00100000:1.0:1789480313.116048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480313.140519:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552022784:0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.140610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480313.140676:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022272 00000100:00100000:0.0:1789480313.140685:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022272 00000100:00100000:0.0:1789480313.140732:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789480313.140740:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:3298:x1876405552022272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.140794:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:3298:x1876405552022272:12345-0@lo:400:kworker.0 Request processed in 54us (24894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480313.140814:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789480313.140849:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022656 00000100:00100000:0.0:1789480313.140854:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022656 00000100:00100000:0.0:1789480313.140877:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022784 00000100:00100000:0.0:1789480313.140880:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022784 00000100:00100000:0.0:1789480313.140904:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480313.140910:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552022656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.140958:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552022656:12345-0@lo:400:kworker.0 Request processed in 48us (24909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480313.140964:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480313.140976:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789480313.140982:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552022784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.141022:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552022784:12345-0@lo:400:kworker.0 Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480313.141028:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789480313.141051:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789480313.141078:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a4bb6300 x1876405552022784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480313.141092:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552022784:0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.141120:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552022272:0@lo:400:kworker.0 00000100:00100000:0.0:1789480313.149454:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552022400:0@lo:8:kworker.0 00000100:00100000:0.0:1789480313.149830:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480313.149933:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552022528:0@lo:8:kworker.0 00000100:00100000:0.0:1789480313.149961:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789480313.154056:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a4bb5880 x1876405552022656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480313.154075:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552022656:0@lo:400:kworker.0 00000100:00100000:3.0:1789480313.160928:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022400 00000100:00100000:3.0:1789480313.160942:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022400 00000100:00100000:3.0:1789480313.160982:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022528 00000100:00100000:3.0:1789480313.160986:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022528 00000100:00100000:3.0:1789480313.161002:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480313.161010:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405552022400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789480313.161042:0:19551:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 606 last 0 00000020:00000080:3.0:1789480313.161071:0:19551:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fed74 00002000:00100000:3.0:1789480313.161086:0:19551:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2283eaf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789480313.161091:0:19551:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789480313.161093:0:19551:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789480313.166372:0:19551:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789480313.166419:0:19551:0:(import.c:65:import_set_state_nolock()) ffff8d2283eaf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480313.166521:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876405552022400:12345-0@lo:8:kworker.0 Request processed in 5509us (16966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480313.166532:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480313.166578:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480313.166586:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405552022528:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789480313.166603:0:19551:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789480313.168829:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a4bb4700 x1876405552022400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480313.168848:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789480313.168863:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789480313.168879:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789480313.168889:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789480313.168892:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb3bc800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789480313.173663:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789480313.173689:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552022400:0@lo:8:kworker.0 00000004:00080000:1.0:1789480313.173798:0:18889:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:1.0:1789480313.173830:0:18889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd787480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18889:1876405552023040:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789480313.174233:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552022912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480313.174262:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480313.178003:0:18889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480313.178104:0:18889:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480313.178163:0:19553:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789480313.178193:0:19553:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789480313.182894:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552022912 00000100:00100000:1.0:1789480313.182909:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552022912 00000100:00100000:1.0:1789480313.182975:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480313.182985:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405552022912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480313.183026:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480313.183117:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405552022912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (8853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480313.183142:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1789480313.183168:0:18888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789480313.183502:0:18888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 606180217868ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789480313.183566:0:19554:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789480313.183576:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023040 00000100:00100000:1.0:1789480313.183580:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023040 00000100:00080000:1.0:1789480313.183602:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480313.183640:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22bd786300 x1876405552022912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480313.183663:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552022912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480313.223013:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405552022528:12345-0@lo:8:kworker.0 Request processed in 56419us (73043us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789480313.223029:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480313.223060:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480313.223073:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18889:x1876405552023040:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789480313.223333:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480313.223341:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789480313.223345:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552022528:0@lo:8:kworker.0 00002000:00080000:3.0:1789480313.227066:0:19551:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789480313.227077:0:19551:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789480313.227083:0:19551:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:3.0:1789480313.247367:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.247381:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.247399:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.247404:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.247410:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.247428:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.247525:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.247533:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.247554:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789480313.248604:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.248612:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.248624:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.248628:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.248633:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.248644:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.248653:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.248661:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.248751:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789480313.249191:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.249197:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.249207:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.249210:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.249214:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.249224:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.249233:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.249240:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249279:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789480313.249310:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249318:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d3800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.249324:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249335:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249355:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.249357:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480313.249371:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb5918f2/0xbb972366037fed7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249392:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480313.249396:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249403:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.249412:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249419:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249429:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.249449:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.249451:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.249454:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.249586:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789480313.249592:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fed89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.250117:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.250131:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.250138:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250153:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.250157:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.250161:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250171:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250194:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250203:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250225:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480313.250542:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480313.250547:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.250554:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.250557:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.250566:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.250578:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.250584:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6c61a6b/0xbb972366037fed90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.250604:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.250606:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.250607:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.250965:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.250971:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250979:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.250982:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.250987:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.250996:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.251013:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.251021:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.251041:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480313.251507:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480313.251512:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.251519:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.251523:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.251530:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.251544:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.251550:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a65892a/0xbb972366037fed97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.251564:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.251565:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.251567:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.252271:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.252279:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.252308:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.252312:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.252317:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.252327:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.252335:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.252343:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.252370:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480313.254555:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.254564:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254575:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.254579:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254589:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254608:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254616:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fed9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.254636:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.254644:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254651:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.254655:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254678:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254690:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254698:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e54aa6d/0xbb972366037fed82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.254716:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.254719:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.254721:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.254744:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.254747:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.254749:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480313.256705:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480313.256718:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.256734:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1789480313.256739:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480313.256747:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.256776:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.256787:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.256794:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.256819:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480313.256892:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480313.256902:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.256926:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39dc00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.256931:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.256941:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.256960:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.256968:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6cacfe/0xbb972366037feda5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.256988:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.256990:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.256991:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789480313.259554:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789480313.260565:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480313.260576:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.260594:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1789480313.260599:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480313.260606:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.260620:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.260632:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.260641:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.260667:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480313.261161:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480313.261168:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261191:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1789480313.261201:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480313.261206:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261216:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261225:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261232:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261249:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789480313.261328:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480313.261345:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.261361:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.261368:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.261603:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.261612:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.261623:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.261629:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.261646:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.261646:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.261718:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.261724:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.261736:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005950aad8/0xbb972366037fedb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480313.261741:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480313.261764:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.261785:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a508d1be/0xbb972366037fedac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.261788:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480313.261788:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.261795:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.261801:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480313.261807:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480313.261818:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261831:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.261841:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480313.261842:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.261847:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.261850:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480313.261862:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.261890:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480313.262092:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.262100:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.262111:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ce00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.262116:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.262126:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.262140:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.262147:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037fedba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.265579:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.265586:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.265590:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480313.272402:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480313.272417:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.272435:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1789480313.272440:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480313.272447:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.272463:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.272475:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.272484:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480313.272510:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480313.272625:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.272634:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.272644:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39cc00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.272650:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.272660:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.272679:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.272701:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ea7a81/0xbb972366037fedc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.272726:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.272728:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.272729:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.280629:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.280643:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.280662:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.280667:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.280674:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.280688:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.280700:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.280707:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.280763:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480313.281225:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480313.281233:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.281243:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.281247:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.281258:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.281321:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.281328:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abde309f/0xbb972366037fedc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.281350:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.281352:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.281354:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.282699:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.282714:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.282728:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.282732:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.282738:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.282752:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.282762:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.282770:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.282797:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480313.283217:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480313.283225:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.283235:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480313.283240:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.283250:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.283267:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.283275:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fedcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.283331:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.283333:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.283335:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480313.287837:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.287851:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.287868:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.287873:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.287879:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.287891:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.287902:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.287910:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.287932:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480313.288455:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.288463:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.288473:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.288478:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.288487:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.288511:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.288518:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fedd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480313.288664:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.288670:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.288692:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.288695:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.288699:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.288708:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.288717:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.288726:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.288802:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480313.289159:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.289165:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.289188:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.289191:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.289196:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.289205:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.289225:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.289232:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.289272:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480313.289279:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.289308:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.289314:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.289321:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.289327:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.289339:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.289342:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.289344:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.289363:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.289364:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.289386:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.289388:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.289391:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.289392:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.289402:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037feddd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.289420:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.289422:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.289424:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.289653:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.289658:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fede4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480313.290126:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.290132:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290142:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.290146:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.290150:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290159:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290167:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290205:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290264:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480313.290710:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.290716:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290725:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.290727:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.290731:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290739:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290746:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.290753:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.290864:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480313.290871:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.290879:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.290885:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.290895:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.290896:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.290904:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.290924:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.290938:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.290940:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fea1225/0xbb972366037fedeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.290944:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.290959:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.290971:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.290975:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.290976:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.290977:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.290991:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.290995:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.290998:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.291038:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.291043:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f258f68d/0xbb972366037fedf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480313.291483:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.291489:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.291498:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.291501:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.291505:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.291514:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.291521:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.291528:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.291672:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.291678:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.291686:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.291690:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.291698:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.291712:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.291724:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.291726:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.291730:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.291792:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.291797:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032a477f0/0xbb972366037fedf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480313.292163:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.292169:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292203:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.292206:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.292210:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292219:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292226:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292232:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.292260:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.292265:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.292272:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.292275:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.292302:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.292314:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292419:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.292425:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c57c6de8/0xbb972366037fee00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.292433:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.292437:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480313.292912:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.292920:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292928:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.292931:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.292935:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292955:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292963:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.292970:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.293275:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.293313:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.293322:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.293325:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.293333:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.293347:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.293370:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.293371:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.293373:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.300918:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.300939:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fee07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.301523:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.301533:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480313.301855:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.301863:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.301879:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.301883:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.301889:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.301904:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.301927:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.301934:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.301996:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480313.302523:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.302531:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.302540:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.302544:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.302549:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.302559:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.302567:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.302574:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.302719:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480313.302727:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.302736:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.302741:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.302751:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.302769:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.302778:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fee0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.302863:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.302869:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.302877:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.302880:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.302889:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.302914:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.302926:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.302928:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.302931:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.302965:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.302971:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e33108/0xbb972366037fee15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.302994:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480313.303582:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.303588:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.303599:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.303603:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.303608:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.303619:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.303626:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.303633:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.303691:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480313.304137:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.304143:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.304159:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.304163:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.304168:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.304193:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.304203:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.304211:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.304976:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480313.304985:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.304994:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.305007:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305018:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305036:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305044:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97863cc/0xbb972366037fee1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305068:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.305072:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305080:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.305084:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305092:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305104:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.305114:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.305123:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.305125:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480313.305385:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480313.305392:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eac67e75/0xbb972366037fee23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.305517:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480313.306097:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.306105:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.306119:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.306123:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.306128:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.306151:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.306161:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.306169:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.306202:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480313.307243:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.307251:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.307263:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.307267:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.307273:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.307302:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.307313:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.307331:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.307353:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789480313.307942:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480313.308014:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308024:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.308029:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308038:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308054:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308062:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a4a2a7/0xbb972366037fee2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308086:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.308089:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308095:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.308098:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308117:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308129:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308136:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096ed9617/0xbb972366037fee31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.308149:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.308151:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.308152:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.310227:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480313.310812:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480313.310823:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.310840:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1789480313.310844:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480313.310851:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.310865:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.310874:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.310881:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480313.310907:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480313.312797:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.312809:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.312820:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.312825:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.312837:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.312856:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.312865:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000987e14d3/0xbb972366037fee38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.312909:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.312911:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.312913:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.314122:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.314132:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.314145:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.314149:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.314155:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.314167:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.314193:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.314201:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.314226:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480313.314433:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.314451:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.314459:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.314463:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.314472:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.314489:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.314509:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004268501e/0xbb972366037fee3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.314525:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.314536:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.314538:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480313.315872:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480313.315881:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.315904:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=606s v=(0 0) 00010000:00010000:3.0:1789480313.315908:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480313.315914:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.315925:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.315935:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.315943:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.315963:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480313.316030:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480313.316037:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.316051:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480313.316055:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.316064:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.316080:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.316088:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e7223d2/0xbb972366037fee46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.316106:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.316108:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480313.316110:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480313.322251:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480313.322263:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.322310:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=606s v=(0 0) 00010000:00010000:2.0:1789480313.322316:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480313.322323:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.322338:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.322349:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.322357:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480313.322380:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480313.323037:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480313.323047:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.323056:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480313.323061:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.323071:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.323103:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.323111:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8fe52a5/0xbb972366037fee4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480313.323130:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.323132:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480313.323135:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789480313.323574:0:19551:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:1.0:1789480313.323672:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18889:x1876405552023040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100600us (149755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480313.323687:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480313.324226:0:18889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd787480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18889:1876405552023040:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789480313.324242:0:18889:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1789480313.324689:0:18889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18889:1876405552023168:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789480313.324734:0:18889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480313.324785:0:18889:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789480313.325100:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023168 00000100:00100000:1.0:1789480313.325108:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023168 00000100:00100000:1.0:1789480313.325161:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480313.325182:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18889:x1876405552023168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789480313.325224:0:19554:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:1.0:1789480313.329372:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18889:x1876405552023168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4195us (4630us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789480313.329385:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480313.331321:0:18889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18889:1876405552023168:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789480313.331342:0:18889:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:2.0:1789480314.141362:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789480314.292655:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789480314.292692:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789480315.162588:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480316.192622:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480317.210583:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480318.238353:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480318.301151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480318.301159:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789480318.301164:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480318.301174:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:3.0:1789480318.301183:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789480318.301199:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d229c447000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789480318.301228:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a485d180 x1876405552023552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480318.304405:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552023680:0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.304530:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480318.304630:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480318.304638:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552023424:0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.304671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480318.304736:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552023552:0@lo:8:kworker.0 00000100:00100000:0.0:1789480318.305237:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480318.305359:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023424 00000100:00100000:2.0:1789480318.305370:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023424 00000100:00100000:0.0:1789480318.305483:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023680 00000100:00100000:0.0:1789480318.305488:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023680 00000100:00100000:0.0:1789480318.305536:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480318.305547:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552023680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.305614:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552023680:12345-0@lo:400:kworker.0 Request processed in 69us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480318.305623:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789480318.305676:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a485ca80 x1876405552023680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480318.305693:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552023680:0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.307003:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552023808:0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.307089:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480318.307324:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480318.307333:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552023296:0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.307372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480318.307508:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023808 00000100:00100000:0.0:1789480318.307515:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023808 00000100:00100000:0.0:1789480318.307564:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789480318.307574:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552023808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.307626:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552023808:12345-0@lo:400:kworker.0 Request processed in 54us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480318.307644:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789480318.307668:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023296 00000100:00100000:0.0:1789480318.307672:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023296 00000100:00100000:0.0:1789480318.307696:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789480318.307702:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:3298:x1876405552023296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.307731:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:3298:x1876405552023296:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480318.307737:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789480318.307786:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552023936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480318.308922:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480318.309118:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552023296:0@lo:400:kworker.0 00010000:00080000:0.0:1789480318.309319:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a485c380 x1876405552023808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480318.309335:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552023808:0@lo:400:kworker.0 00000100:00100000:0.0:1789480318.310393:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023552 00000100:00100000:0.0:1789480318.310406:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023552 00000100:00100000:0.0:1789480318.310451:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480318.310460:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405552023552:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789480318.310486:0:19551:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789480318.313962:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480318.313993:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552023424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480318.314142:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552023424:12345-0@lo:400:kworker.0 Request processed in 166us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480318.314150:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480318.314257:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789480318.314302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552023424:0@lo:400:kworker.0 00000100:00080000:1.0:1789480318.317377:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480318.317391:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480318.317466:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552023936 00000100:00100000:1.0:1789480318.317483:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552023936 00000100:00100000:1.0:1789480318.317556:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480318.317568:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552023936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480318.317630:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480318.317758:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552023936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (8839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480318.317766:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480318.317845:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552023936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480318.347799:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405552023552:12345-0@lo:8:kworker.0 Request processed in 37326us (42550us total) trans 0 rc -19/-19 00000100:00080000:3.0:1789480318.348215:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480318.348224:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789480318.348229:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552023552:0@lo:8:kworker.0 00000100:00100000:0.0:1789480318.351567:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789480319.282248:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480320.284266:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480321.307062:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480321.762505:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789480322.330737:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789480322.946227:0:20273:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789480322.946234:0:20273:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789480322.946406:0:20273:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2291dbf000 00000020:01000004:0.0:1789480322.946425:0:20273:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789480322.946441:0:20273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789480322.946457:0:20273:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d22b99c3380) 00000020:00000080:0.0:1789480322.946475:0:20273:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789480322.996462:0:20273:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789480323.003747:0:20273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789480323.004674:0:20273:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789480323.005836:0:20273:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789480323.006507:0:20273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1789480323.009345:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 402: rc = 0 00100000:10000000:2.0:1789480323.009448:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 402: rc = 0 00100000:10000000:2.0:1789480323.010206:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 402: rc = 0 00100000:10000000:2.0:1789480323.011462:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1789480323.013195:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1789480323.013536:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1789480323.014150:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1789480323.015364:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1789480323.015714:0:20273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00000020:00000080:2.0:1789480323.020218:0:20273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789480323.020237:0:20273:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789480323.020251:0:20273:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb972366037fee5b 00000020:01000004:2.0:1789480323.020262:0:20273:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789480323.020564:0:20273:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789480323.020569:0:20273:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789480323.020705:0:20273:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789480323.021000:0:20273:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789480323.021006:0:20273:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789480323.063555:0:20273:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789480323.063624:0:20273:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789480323.063630:0:20273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789480323.063636:0:20273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789480323.063638:0:20273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480323.063639:0:20273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480323.063640:0:20273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480323.063641:0:20273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480323.063643:0:20273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480323.063645:0:20273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480323.063646:0:20273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789480323.063650:0:20273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789480323.063652:0:20273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789480323.063654:0:20273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789480323.063655:0:20273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480323.063656:0:20273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480323.063657:0:20273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480323.063657:0:20273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480323.063658:0:20273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480323.063659:0:20273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480323.063660:0:20273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789480323.063695:0:20273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789480323.064177:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789480323.064313:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480323.064446:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22baa7e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.066233:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024064 00000100:00100000:0.0:1789480323.066250:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024064 00000100:00100000:0.0:1789480323.066380:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789480323.066392:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:20273:x1876405552024064:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789480323.066470:0:18861:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789480323.066474:0:18861:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789480323.066480:0:18861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789480323.133780:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:20273:x1876405552024064:12345-0@lo:253:mount.lustre.0 Request processed in 67374us (69480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.133800:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789480323.133940:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789480323.133961:0:20273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789480323.133964:0:20273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789480323.133967:0:20273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789480323.133968:0:20273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480323.133970:0:20273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480323.133971:0:20273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480323.133972:0:20273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480323.133974:0:20273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480323.133976:0:20273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480323.133978:0:20273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789480323.134015:0:20273:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2291dbf000 from lustre-OST0001 10000000:01000000:3.0:1789480323.134064:0:20273:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789480323.134068:0:20273:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789480323.134079:0:20273:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d21852a8000 local copy 00010000:00010000:3.0:1789480323.134107:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480323.134469:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480323.134518:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480323.134565:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22baa7e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.134761:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024192 00000100:00100000:0.0:1789480323.134770:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024192 00000100:00100000:0.0:1789480323.134826:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789480323.134837:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:20273:x1876405552024192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480323.135179:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+16:20273:x1876405552024192:12345-0@lo:501:mount.lustre.0 Request processed in 343us (659us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480323.135188:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480323.135359:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024192:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789480323.135381:0:20273:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789480323.135579:0:20273:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789480323.135588:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480323.135600:0:20273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7800/0xbb972366037febec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037febf3 expref: -99 pid: 18848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480323.135630:0:20273:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2291dbf000 10000000:01000000:1.0:1789480323.135636:0:20273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789480323.135643:0:20273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789480323.135646:0:20273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480323.135651:0:20273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789480323.135655:0:20273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789480323.135690:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480323.135700:0:20273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480323.135711:0:20273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480323.135730:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480323.135771:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480323.135816:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.136334:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024320 00000100:00100000:0.0:1789480323.136342:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024320 00000100:00100000:0.0:1789480323.136392:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480323.136403:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+16:20273:x1876405552024320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480323.136432:0:18861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480323.136450:0:18861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185229a00/0xbb972366037fee69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fee62 expref: -99 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.136480:0:18861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185229a00/0xbb972366037fee69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fee62 expref: 17 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.136493:0:18861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185229a00/0xbb972366037fee69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fee62 expref: 17 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.136503:0:18861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229a00, rc 0) 00000100:00100000:0.0:1789480323.136576:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024320:12345-0@lo:101:mount.lustre.0 Request processed in 176us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.136584:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789480323.136761:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480323.136782:0:20273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee69 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480323.136793:0:20273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fee69 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480323.137653:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1789480323.138670:0:20273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480323.138961:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789480323.139024:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789480323.139060:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789480323.139113:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789480323.139151:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789480323.139186:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789480323.139237:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789480323.139275:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789480323.139363:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1789480323.139424:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1789480323.139432:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1789480323.139567:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480323.141032:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.141455:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.141712:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024448 00000100:00100000:0.0:1789480323.141723:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024448 00000100:00100000:0.0:1789480323.141844:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789480323.141857:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480323.142914:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024448:12345-0@lo:501:mount.lustre.0 Request processed in 1054us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.142926:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789480323.144005:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480323.144094:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480323.144180:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480323.144617:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22baa7e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789480323.144787:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024576 00000100:00100000:2.0:1789480323.144796:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024576 00000100:00100000:2.0:1789480323.144859:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789480323.144870:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480323.145667:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024576:12345-0@lo:503:mount.lustre.0 Request processed in 797us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.145677:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789480323.145804:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789480323.147134:0:20273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480323.152829:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480323.152965:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.153080:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480323.156499:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024704 00000100:00100000:1.0:1789480323.156758:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024704 00000100:00100000:0.0:1789480323.156950:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789480323.156964:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480323.157760:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024704:12345-0@lo:502:mount.lustre.0 Request processed in 794us (4790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.157782:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789480323.158013:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480323.158747:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789480323.158823:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789480323.158855:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789480323.158904:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789480323.158944:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789480323.158991:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789480323.159488:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789480323.159712:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789480323.159774:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789480323.159835:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480323.159938:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.160116:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480323.163486:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024832 00000100:00100000:1.0:1789480323.163509:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024832 00000100:00100000:1.0:1789480323.163595:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789480323.163628:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480323.164248:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024832:12345-0@lo:502:mount.lustre.0 Request processed in 620us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480323.164259:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789480323.164436:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480323.164608:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789480323.164643:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789480323.171831:0:20274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789480323.171852:0:20274:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789480323.171863:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.171866:0:20274:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789480323.171875:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789480323.171898:0:20274:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2186a699c0) 00000020:00000080:3.0:1789480323.171929:0:20274:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789480323.171937:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789480323.173159:0:20274:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2291dbf000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789480323.173177:0:20274:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789480323.173447:0:20274:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb972366037fee77 00010000:00010000:2.0:1789480323.181830:0:20274:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789480323.183144:0:20274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:2.0:1789480323.194787:0:20274:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789480323.197701:0:20274:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789480323.198177:0:20274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480323.198368:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480323.198373:0:20274:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789480323.198381:0:20274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480323.198386:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480323.198388:0:20274:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789480323.198391:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789480323.198393:0:20274:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789480323.198396:0:20274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480323.198398:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480323.198400:0:20274:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789480323.198402:0:20274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480323.198404:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480323.198406:0:20274:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789480323.198409:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789480323.198492:0:20274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480323.198497:0:20274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480323.198498:0:20274:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789480323.198501:0:20274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789480323.200159:0:20273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789480323.200218:0:20273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789480323.200252:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee69 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.200269:0:20273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fee62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee69 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480323.200334:0:20273:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2291dbf000 from 1 10000000:01000000:3.0:1789480323.200338:0:20273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480323.200385:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.200393:0:20273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.200407:0:20273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480323.200439:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480323.200698:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480323.201038:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22baa7e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789480323.201136:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552024960 00000100:00100000:3.0:1789480323.201146:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552024960 00000100:00100000:3.0:1789480323.201882:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789480323.201896:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+17:20273:x1876405552024960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480323.201917:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480323.201936:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fee7e expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.201968:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fee7e expref: 18 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.201992:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fee7e expref: 18 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.202015:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480323.203706:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552024960:12345-0@lo:101:mount.lustre.0 Request processed in 1801us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.203963:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552024960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480323.204008:0:20273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.204023:0:20273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480323.205972:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000040:00080000:0.0:1789480323.214448:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1789480323.215206:0:20273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789480323.215515:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789480323.215563:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789480323.215615:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789480323.215655:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789480323.215693:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789480323.215744:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789480323.215784:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789480323.215822:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789480323.215890:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789480323.215901:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1789480323.225180:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480323.226536:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480323.226603:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22913b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480323.227963:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025088 00000100:00100000:2.0:1789480323.227988:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025088 00000100:00100000:2.0:1789480323.230199:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789480323.230238:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480323.230695:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025088:12345-0@lo:501:mount.lustre.0 Request processed in 479us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.230706:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789480323.237403:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480323.237565:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480323.237700:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480323.249990:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22913b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480323.250214:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025216 00000100:00100000:3.0:1789480323.250237:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025216 00000100:00100000:3.0:1789480323.250464:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789480323.250476:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22b9de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480323.251231:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22b9de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025216:12345-0@lo:503:mount.lustre.0 Request processed in 746us (13519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480323.251242:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789480323.265629:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480323.267159:0:20273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480323.268492:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480323.268632:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.268692:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.268799:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025344 00000100:00100000:0.0:1789480323.268808:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025344 00000100:00100000:0.0:1789480323.268882:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789480323.268893:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480323.269261:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025344:12345-0@lo:502:mount.lustre.0 Request processed in 368us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.269271:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789480323.271966:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480323.272591:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789480323.274055:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789480323.274145:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789480323.274183:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789480323.274214:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789480323.276617:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789480323.279023:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789480323.279124:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1789480323.279200:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480323.281047:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.281150:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480323.293548:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025472 00000100:00100000:1.0:1789480323.293568:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025472 00000100:00100000:1.0:1789480323.293910:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789480323.293925:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480323.294527:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025472:12345-0@lo:502:mount.lustre.0 Request processed in 603us (13488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480323.294538:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789480323.301339:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480323.301912:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789480323.301937:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789480323.303658:0:20278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480323.303673:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.303676:0:20278:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789480323.303685:0:20278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2291dbf000 00000020:00000080:3.0:1789480323.303688:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480323.303697:0:20278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480323.303700:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.303702:0:20278:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789480323.303704:0:20278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480323.303706:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.303708:0:20278:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789480323.303711:0:20278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2291dbf000 00000020:00000080:3.0:1789480323.303713:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480323.303913:0:20278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480323.303917:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.303929:0:20278:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789480323.303933:0:20278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480323.303936:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.303937:0:20278:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480323.303941:0:20278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2291dbf000 00000020:00000080:3.0:1789480323.303944:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480323.303997:0:20278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480323.304002:0:20278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480323.304004:0:20278:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789480323.304007:0:20278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1789480323.305951:0:20273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789480323.306017:0:20273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480323.306046:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480323.306063:0:20273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480323.306126:0:20273:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789480323.306130:0:20273:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2291dbf000 10000000:01000000:1.0:1789480323.306134:0:20273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2291dbf000 10000000:01000000:1.0:1789480323.306139:0:20273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480323.306146:0:20273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2291dbf000 from 1 10000000:01000000:1.0:1789480323.306149:0:20273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789480323.306199:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480323.306209:0:20273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480323.306235:0:20273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480323.306269:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480323.306384:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480323.306440:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480323.308637:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025600 00000100:00100000:3.0:1789480323.308655:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025600 00000100:00100000:3.0:1789480323.308740:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789480323.308752:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552025600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480323.308783:0:18861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480323.308808:0:18861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fee93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fee8c expref: -99 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.308844:0:18861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fee93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fee8c expref: 19 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.308857:0:18861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fee93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fee8c expref: 19 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.308867:0:18861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5c00, rc 0) 00000100:00100000:3.0:1789480323.308967:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025600:12345-0@lo:101:mount.lustre.0 Request processed in 217us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480323.308974:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480323.309171:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480323.309196:0:20273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee93 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480323.309206:0:20273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fee93 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480323.314497:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1789480323.318358:0:20273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480323.322566:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789480323.322648:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789480323.322685:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789480323.323098:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789480323.323142:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789480323.323195:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789480323.324467:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789480323.325622:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789480323.325752:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789480323.325972:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789480323.326025:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789480323.326113:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789480323.326152:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789480323.326181:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789480323.326244:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789480323.326315:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789480323.326354:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789480323.326403:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789480323.326438:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789480323.326476:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789480323.326541:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789480323.326582:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789480323.326633:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789480323.326684:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789480323.326720:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1789480323.326753:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1789480323.326822:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1789480323.326879:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1789480323.326920:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1789480323.328191:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1789480323.328273:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1789480323.328333:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1789480323.328365:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1789480323.328411:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1789480323.328443:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1789480323.328484:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1789480323.328525:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1789480323.328554:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1789480323.328593:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1789480323.328624:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1789480323.329122:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1789480323.329132:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1789480323.329373:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480323.329468:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.332713:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480323.333672:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025728 00000100:00100000:3.0:1789480323.333687:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025728 00000100:00100000:3.0:1789480323.333908:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789480323.333937:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480323.334395:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025728:12345-0@lo:501:mount.lustre.0 Request processed in 461us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480323.334405:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789480323.340143:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480323.340366:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480323.340464:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.340520:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.340573:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025856 00000100:00100000:0.0:1789480323.340583:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025856 00000100:00100000:0.0:1789480323.340650:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789480323.340661:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480323.343054:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025856:12345-0@lo:503:mount.lustre.0 Request processed in 2383us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.343070:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789480323.343921:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480323.348432:0:20273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480323.348592:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480323.348695:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.352961:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480323.353022:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552025984 00000100:00100000:2.0:1789480323.353035:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552025984 00000100:00100000:2.0:1789480323.353151:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789480323.353164:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480323.356433:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552025984:12345-0@lo:502:mount.lustre.0 Request processed in 3259us (7725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.356449:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1789480323.365987:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480323.366055:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552025984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480323.378369:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789480323.378501:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789480323.378570:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789480323.378649:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789480323.378699:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789480323.378757:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789480323.379704:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789480323.380960:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789480323.381631:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789480323.381681:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789480323.383007:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789480323.383146:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789480323.383193:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789480323.385163:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789480323.387091:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789480323.387192:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789480323.387227:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789480323.387275:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789480323.387332:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789480323.387370:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789480323.387455:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789480323.387514:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789480323.387553:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789480323.387606:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789480323.387644:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1789480323.387675:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1789480323.387720:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1789480323.387754:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1789480323.390011:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1789480323.394340:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1789480323.394428:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1789480323.394466:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1789480323.394500:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1789480323.394547:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1789480323.394586:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1789480323.394640:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1789480323.394714:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1789480323.395164:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1789480323.395238:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1789480323.395277:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1789480323.395420:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552026112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480323.395525:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480323.395588:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23df900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480323.395880:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026112 00000100:00100000:3.0:1789480323.395891:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026112 00000100:00100000:3.0:1789480323.395957:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789480323.395968:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552026112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480323.396305:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552026112:12345-0@lo:502:mount.lustre.0 Request processed in 314us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480323.396315:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789480323.396496:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552026112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480323.396701:0:20273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1789480323.396718:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789480323.404955:0:20283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789480323.404988:0:20283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d22b99c4d40) 00000020:00000080:0.0:1789480323.405019:0:20283:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789480323.405116:0:20283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2291dbf000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789480323.405121:0:20283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2291dbf000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789480323.405125:0:20283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2291dbf000 3 00010000:00080000:0.0:1789480323.405164:0:20283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d218560a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1789480323.409008:0:20283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789480323.413418:0:20283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789480323.413481:0:20283:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789480323.413502:0:20283:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbb972366037feea1 00000100:00080000:0.0:1789480323.413520:0:20283:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480323.413548:0:20283:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d218560a000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480323.413600:0:20283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4bb4e00 x1876405552026240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480323.413637:0:20283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789480323.413763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480323.413769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789480323.413772:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480323.413776:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 611 00000100:00080000:2.0:1789480323.413779:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789480323.413785:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d229c447000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480323.413801:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187731500 x1876405552026496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480323.413860:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552026624:0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.413941:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.413999:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480323.414006:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552026368:0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.414036:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.414062:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552026752:0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.414090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.414147:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026624 00000100:00100000:2.0:1789480323.414155:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026624 00000100:00100000:2.0:1789480323.414200:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026752 00000100:00100000:2.0:1789480323.414204:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026752 00000100:00100000:2.0:1789480323.414233:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480323.414243:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552026624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.414348:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552026624:12345-0@lo:400:kworker.0 Request processed in 105us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.414356:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480323.414372:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480323.414377:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.414405:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552026752:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.414410:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480323.414430:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026368 00000100:00100000:2.0:1789480323.414434:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026368 00000100:00100000:2.0:1789480323.414460:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480323.414479:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552026368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.414519:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552026368:12345-0@lo:400:kworker.0 Request processed in 44us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.414525:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789480323.414568:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2187733480 x1876405552026752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480323.414584:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552026752:0@lo:400:kworker.0 00000100:00100000:2.0:1789480323.414615:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552026368:0@lo:400:kworker.0 00010000:00080000:2.0:1789480323.414625:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2187733800 x1876405552026624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480323.414641:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552026624:0@lo:400:kworker.0 00000100:00100000:1.0:1789480323.415552:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405552026240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480323.415638:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480323.415697:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552026496:0@lo:8:kworker.0 00000100:00100000:1.0:1789480323.415726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789480323.415941:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480323.415948:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480323.415966:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026496 00000100:00100000:2.0:1789480323.415972:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026240 00000100:00100000:1.0:1789480323.415986:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026496 00000100:00100000:2.0:1789480323.415994:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026240 00000100:00100000:2.0:1789480323.416029:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480323.416033:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480323.416041:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405552026240:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480323.416043:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876405552026496:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789480323.416372:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876405552026496:12345-0@lo:8:kworker.0 Request processed in 329us (644us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789480323.416380:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789480323.416623:0:18866:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 616 last 0 00000020:00000080:2.0:1789480323.416678:0:18866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbb972366037feea8 00000004:00100000:2.0:1789480323.416697:0:18866:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789480323.416738:0:18866:0:(import.c:65:import_set_state_nolock()) ffff8d229164f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480323.416788:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876405552026240:12345-0@lo:38:llog_process_th.0 Request processed in 748us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480323.416796:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789480323.417473:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4bb4e00 x1876405552026240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480323.417488:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789480323.417499:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789480323.417508:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789480323.417514:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789480323.417517:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d218560a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789480323.417525:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405552026240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789480323.417553:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789480323.417558:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480323.417579:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789480323.417582:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552026496:0@lo:8:kworker.0 00000040:00080000:0.0:1789480323.418118:0:20283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:2.0:1789480323.418781:0:20273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789480323.418832:0:20273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789480323.418850:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee93 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480323.418863:0:20273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fee8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fee93 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789480323.418934:0:20273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789480323.418936:0:20273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789480323.418938:0:20273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480323.418939:0:20273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480323.418941:0:20273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480323.418942:0:20273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480323.418944:0:20273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480323.418946:0:20273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480323.418952:0:20273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789480323.418956:0:20273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789480323.418959:0:20273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789480323.418960:0:20273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789480323.418961:0:20273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480323.418962:0:20273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480323.418963:0:20273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480323.418964:0:20273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480323.418964:0:20273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480323.418965:0:20273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480323.418966:0:20273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789480323.419007:0:20273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789480323.419031:0:20273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552026880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789480323.419114:0:20273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480323.419158:0:20273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480323.419185:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552026880 00000100:00100000:2.0:1789480323.419192:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552026880 00000100:00100000:2.0:1789480323.419246:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789480323.419256:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:20273:x1876405552026880:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480323.420325:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552027008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480323.420394:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480323.420695:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027008 00000100:00100000:0.0:1789480323.420705:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027008 00000100:00100000:0.0:1789480323.420776:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480323.420786:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552027008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480323.420828:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480323.420886:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552027008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.420894:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:2.0:1789480323.420985:0:18860:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789480323.421005:0:18860:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789480323.422629:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552027008:0@lo:13:osp-pre-0-0.0 20000000:01000000:3.0:1789480323.506701:0:18860:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789480323.506731:0:18860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789480323.507870:0:18882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789480323.507891:0:18882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789480323.507923:0:18882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.507945:0:18882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed66 expref: 19 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.507954:0:18882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.508019:0:18882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fed66 expref: 19 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.508037:0:18882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fed66 expref: 19 pid: 18860 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480323.508054:0:18882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18882:1876405552027136:0@lo:104: 00000100:00100000:0.0:1789480323.508156:0:18882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480323.508207:0:18882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23dfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480323.508252:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027136 00000100:00100000:0.0:1789480323.508261:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027136 00000100:00100000:0.0:1789480323.510612:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480323.510640:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2016df8a-d509-4535-998f-23fecb5de199+3:18882:x1876405552027136:12345-0@lo:104: 00010000:00010000:0.0:1789480323.510665:0:18849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.510789:0:18849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480323.510796:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2016df8a-d509-4535-998f-23fecb5de199+3:18882:x1876405552027136:12345-0@lo:104: Request processed in 171us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.510803:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789480323.510838:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480323.510846:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.510854:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789480323.510859:0:19959:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.510870:0:19959:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480323.510877:0:19959:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480323.510883:0:19959:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789480323.510928:0:19959:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.510957:0:19959:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480323.511003:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.511012:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7200/0xbb972366037fed66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fed6d expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.511033:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480323.511035:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552027264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480323.511035:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480323.511037:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480323.511093:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480323.511915:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027264 00000100:00100000:0.0:1789480323.511927:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027264 00010000:00010000:0.0:1789480323.511968:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fed66 expref: 20 pid: 18860 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480323.512015:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480323.512023:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+20:3300:x1876405552027264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480323.512038:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480323.512045:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fed66 expref: 20 pid: 18860 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512061:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fed66 expref: 20 pid: 18860 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512084:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512093:0:18851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789480323.512127:0:18851:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004247174s 00010000:00010000:0.0:1789480323.512133:0:18851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512142:0:18851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512148:0:18851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512155:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512162:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480323.512167:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512176:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512185:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480323.512197:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480323.512309:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+20:3300:x1876405552027264:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480323.512316:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480323.512324:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552027264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480323.512590:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fed6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fed66 expref: 19 pid: 18860 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480323.512606:0:18882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18882:1876405552027136:0@lo:104: 00010000:00010000:3.0:1789480323.512622:0:18882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.512631:0:18882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.512638:0:18882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480323.512646:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2185228c00/0xbb972366037feeaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480323.546445:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+18:20273:x1876405552026880:12345-0@lo:253:mount.lustre.0 Request processed in 127175us (127315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480323.546465:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789480323.547040:0:20273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2016df8a-d509-4535-998f-23fecb5de199:20273:1876405552026880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789480323.547062:0:20273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789480323.547066:0:20273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789480323.547068:0:20273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789480323.547069:0:20273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480323.547071:0:20273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480323.547072:0:20273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480323.547073:0:20273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480323.547075:0:20273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480323.547784:0:20273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480323.547788:0:20273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789480323.547813:0:20273:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789480323.554533:0:20273:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480323.554713:0:20273:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789480323.554861:0:20273:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480323.555008:0:20273:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789480323.555163:0:20273:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789480323.555385:0:20273:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789480323.557897:0:20273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789480323.599607:0:20273:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789480323.599615:0:20273:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789480323.599650:0:20273:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789480323.599717:0:20273:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789480323.599736:0:20273:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789480323.599764:0:20273:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789480324.378408:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789480325.210487:0:18863:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789480325.210494:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d218785b000 from 11 10000000:01000000:0.0:1789480325.210499:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480325.210560:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480325.210573:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480325.210587:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480325.210616:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552027392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480325.210681:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480325.210734:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480325.210797:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027392 00000100:00100000:1.0:1789480325.210807:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027392 00000100:00100000:1.0:1789480325.210877:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789480325.210889:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552027392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480325.210915:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480325.210929:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39c800/0xbb972366037feebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037feeb6 expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480325.210965:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39c800/0xbb972366037feebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037feeb6 expref: 19 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480325.210976:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39c800/0xbb972366037feebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037feeb6 expref: 19 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480325.210987:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c800, rc 0) 00000100:00100000:1.0:1789480325.211054:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552027392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480325.211061:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789480325.211338:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552027392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480325.211355:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feebd expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480325.211366:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037feebd expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480325.211424:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552027520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480325.211458:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480325.211481:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480325.211560:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027520 00000100:00100000:1.0:1789480325.211565:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027520 00000100:00100000:1.0:1789480325.211586:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789480325.211592:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552027520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789480325.211605:0:18860:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789480325.211621:0:18860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789480325.211625:0:18860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789480325.211843:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552027520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 249us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480325.211851:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789480325.211914:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552027520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789480325.211983:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789480325.211990:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feebd expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480325.211999:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2185229600/0xbb972366037feeb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037feebd expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480325.405047:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480326.439801:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480327.450576:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.476799:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789480328.539402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480328.539409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789480328.539412:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480328.539430:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d229c447000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480328.539450:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187733480 x1876405552027904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480328.539980:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552027776:0@lo:400:kworker.0 00000100:00100000:2.0:1789480328.540044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480328.540197:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552027648:0@lo:400:kworker.0 00000100:00100000:0.0:1789480328.540231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480328.540782:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027776 00000100:00100000:3.0:1789480328.540791:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027776 00000100:00100000:3.0:1789480328.540857:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480328.540867:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552027776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480328.540931:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552027776:12345-0@lo:400:kworker.0 Request processed in 66us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480328.540939:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480328.540964:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405552028160:0@lo:400:kworker.0 00000100:00100000:3.0:1789480328.540993:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480328.541123:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552027776:0@lo:400:kworker.0 00000100:00100000:2.0:1789480328.541145:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480328.541170:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480328.541271:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480328.541294:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552028032:0@lo:400:kworker.0 00000100:00100000:2.0:1789480328.541322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480328.542308:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552028288:0@lo:400:kworker.0 00000100:00100000:0.0:1789480328.542347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480328.542385:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552027904:0@lo:8:kworker.0 00000100:00100000:0.0:1789480328.542409:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480328.542439:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027648 00000100:00100000:0.0:1789480328.542445:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027648 00000100:00100000:0.0:1789480328.542477:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789480328.542484:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552027648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480328.542522:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552027648:12345-0@lo:400:kworker.0 Request processed in 38us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.542529:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789480328.542557:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028416 00000100:00100000:0.0:1789480328.542562:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028416 00000100:00100000:0.0:1789480328.542586:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480328.542593:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552028416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480328.542619:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480328.542654:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552028416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.542661:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480328.542679:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028160 00000100:00100000:0.0:1789480328.542682:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028160 00000100:00100000:0.0:1789480328.542703:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028032 00000100:00100000:0.0:1789480328.542706:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028032 00000100:00100000:0.0:1789480328.542718:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028288 00000100:00100000:0.0:1789480328.542720:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028288 00000100:00100000:0.0:1789480328.542744:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789480328.542750:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405552028160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480328.542782:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405552028160:12345-0@lo:400:kworker.0 Request processed in 33us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.542788:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789480328.542800:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480328.542805:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552028032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480328.542832:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552028032:12345-0@lo:400:kworker.0 Request processed in 27us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.542838:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480328.542849:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480328.542855:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552028288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480328.542890:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552028288:12345-0@lo:400:kworker.0 Request processed in 23us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.542897:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480328.542916:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552027904 00000100:00100000:0.0:1789480328.542920:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552027904 00000100:00100000:0.0:1789480328.542940:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480328.542945:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1876405552027904:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789480328.542967:0:19553:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 621 last 0 00000020:00000080:0.0:1789480328.542997:0:19553:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037feec4 00002000:00100000:0.0:1789480328.543010:0:19553:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2185609000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789480328.543015:0:19553:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789480328.543018:0:19553:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789480328.543371:0:19553:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789480328.543399:0:19553:0:(import.c:65:import_set_state_nolock()) ffff8d218560a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480328.543438:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1876405552027904:12345-0@lo:8:kworker.0 Request processed in 491us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.543445:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789480328.543495:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2187733480 x1876405552027904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480328.543510:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789480328.543519:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789480328.543524:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789480328.543526:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c447000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789480328.543537:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789480328.543542:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405552027904:0@lo:8:kworker.0 00000004:00080000:0.0:1789480328.543593:0:18891:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789480328.543609:0:18891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18891:1876405552028672:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789480328.543635:0:18891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480328.543652:0:18891:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c900 going to sleep for 11 seconds 00000004:00080000:0.0:1789480328.543666:0:18890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1789480328.543737:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2187733b80 x1876405552028032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480328.543746:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552028032:0@lo:400:kworker.0 00000100:00100000:1.0:1789480328.543771:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480328.543786:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480328.543792:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552028544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480328.543816:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480328.543850:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552027648:0@lo:400:kworker.0 00010000:00080000:1.0:1789480328.543861:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2187730e00 x1876405552028288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480328.543868:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552028288:0@lo:400:kworker.0 00000004:00080000:0.0:1789480328.544046:0:18890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 621540762813ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789480328.544058:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028544 00000100:00100000:1.0:1789480328.544063:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028544 00000100:00100000:0.0:1789480328.544113:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480328.544122:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405552028544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480328.544139:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480328.544191:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405552028544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480328.544197:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789480328.544353:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2187731880 x1876405552028160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480328.544373:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405552028160:0@lo:400:kworker.0 00000100:00080000:3.0:1789480328.544393:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480328.544397:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480328.544400:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480328.544410:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028672 00000100:00100000:3.0:1789480328.544414:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028672 00000100:00100000:3.0:1789480328.544435:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789480328.544441:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18891:x1876405552028672:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1789480328.545399:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4bb4e00 x1876405552028544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480328.545416:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552028544:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1789480328.548858:0:19554:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789480328.548868:0:19554:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1789480328.548873:0:19554:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:3.0:1789480328.558856:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480328.558869:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.558903:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1789480328.558908:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480328.558915:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.558935:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559022:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559042:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559062:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789480328.559673:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480328.559680:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559689:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1789480328.559692:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480328.559696:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559705:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559713:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559721:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559736:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789480328.559747:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480328.559753:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559766:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.559771:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559780:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559796:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559804:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007956a14/0xbb972366037feecb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559821:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.559824:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559831:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.559834:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559841:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559850:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559863:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008acc0e5/0xbb972366037feed2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.559874:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.559889:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.559891:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.559898:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480328.560731:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480328.560739:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560749:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1789480328.560752:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480328.560757:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560767:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560776:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560784:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560800:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.560817:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.560823:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560831:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.560835:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560844:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560857:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560864:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1b9e215/0xbb972366037feed9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.560892:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.560894:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.560896:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480328.561651:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480328.561658:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561668:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1789480328.561671:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480328.561676:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561696:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561704:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561710:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561726:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.561737:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.561741:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561747:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.561751:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561759:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561770:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561776:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004399e8f2/0xbb972366037feee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.561796:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.561798:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.561799:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480328.563440:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789480328.563449:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563521:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1789480328.563526:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480328.563532:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563544:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563554:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563562:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563580:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.563594:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.563599:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563618:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.563622:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563631:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563647:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563655:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ddbd558/0xbb972366037feee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.563670:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.563672:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.563674:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.564182:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.564189:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564199:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.564202:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.564207:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564217:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564231:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564239:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564263:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.564565:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.564572:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.564581:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.564585:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.564593:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.564614:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.564622:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037feeee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.564636:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.564638:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.564640:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.564654:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.564660:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564668:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.564671:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.564674:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564682:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564690:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564697:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.564724:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.565651:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.565657:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.565666:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.565670:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.565679:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.565693:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.565701:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037feef5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.565727:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.565729:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.565730:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.570796:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.570810:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.570827:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.570832:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.570838:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.570853:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.570864:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.570872:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.570913:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480328.571518:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.571526:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571611:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.571622:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.571627:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571637:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571646:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571653:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571668:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789480328.571678:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480328.571684:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571692:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480328.571696:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571706:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571721:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571739:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037feefc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571757:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480328.571760:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571766:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480328.571769:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571776:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571786:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571793:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.571803:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.571805:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.571807:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.572234:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.572241:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.572256:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.572259:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.572264:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.572274:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.572418:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.572427:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.572654:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480328.573237:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480328.573244:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573252:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480328.573255:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573263:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573305:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573314:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e53615c5/0xbb972366037fef0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573330:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.573332:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.573334:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.573631:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.573957:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.573964:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573976:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.573980:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.573985:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.573997:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.574005:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.574013:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.574634:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480328.575115:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.575123:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.575134:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.575137:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.575142:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.575151:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.575160:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.575167:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.575192:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789480328.575845:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480328.575853:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575862:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480328.575866:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575885:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575916:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575922:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc8107ba/0xbb972366037fef11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575942:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480328.575945:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575953:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480328.575957:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575965:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575973:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575981:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a88864/0xbb972366037fef18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.575991:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480328.575992:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480328.575998:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.576580:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.576696:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.576704:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.576714:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.576722:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.576728:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.576739:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.576747:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.576754:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.576779:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.576907:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.576914:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.576922:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.576926:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.576935:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.576949:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.576957:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7af51d/0xbb972366037fef1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.576972:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.576975:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.576976:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.577211:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.577218:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.577227:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.577230:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.577234:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.577244:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.577252:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.577266:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.577305:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480328.577331:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480328.577336:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.577348:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.577352:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.577360:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.577371:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.577378:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0d34564/0xbb972366037fef26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.577391:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.577392:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.577394:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.579700:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.579711:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579726:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.579730:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.579735:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579747:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579758:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579766:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579784:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480328.579795:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480328.579801:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579814:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480328.579819:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579829:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579846:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579853:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea57bb4/0xbb972366037fef2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.579869:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.579870:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.579872:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.580359:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.580367:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580376:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.580379:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.580383:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580392:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580407:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580415:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580430:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480328.580439:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480328.580443:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580450:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480328.580453:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580461:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580473:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580480:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083ce5985/0xbb972366037fef34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.580494:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.580501:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.580503:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.582069:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.582079:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582091:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.582095:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.582101:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582112:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582121:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582128:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582147:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480328.582714:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.582721:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582731:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.582734:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.582738:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582755:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582762:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582769:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.582828:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789480328.583248:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.583255:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.583263:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.583266:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.583270:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.583279:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.583308:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.583325:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583400:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789480328.583409:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.583422:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480328.583423:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.583428:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.583429:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.583436:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480328.583439:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583440:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.583447:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583458:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583466:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004faca5d7/0xbb972366037fef3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583732:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.583737:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583744:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.583748:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583756:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583767:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.583782:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.583784:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.583786:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.583892:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.583898:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de86b80/0xbb972366037fef49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.584055:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.584064:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8fe52a5/0xbb972366037fef42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.584080:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480328.584082:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.584348:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.584355:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.584366:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.584369:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.584374:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.584383:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.584391:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.584398:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.584495:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.584500:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.584507:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.584511:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.584518:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.584531:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.584620:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.584622:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.584623:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.586182:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.586193:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1343f4/0xbb972366037fef50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480328.586634:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.586690:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.586926:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.586935:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.586947:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.586952:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.586957:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.586970:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.586980:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.586988:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.587043:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480328.587471:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.587478:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.587493:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.587496:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.587500:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.587509:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.587519:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.587531:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587653:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480328.587660:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587668:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.587679:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587689:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587704:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587711:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509d270f/0xbb972366037fef57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587727:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.587731:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587737:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.587740:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587747:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587755:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.587761:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.587766:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.587768:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.587824:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.587830:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020665378/0xbb972366037fef5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480328.588273:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.588297:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.588307:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.588310:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.588314:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.588335:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.588343:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.588350:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.588392:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.588398:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.588405:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.588408:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.588415:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.588425:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.588432:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.588433:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.588435:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.588467:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.588472:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008042d22f/0xbb972366037fef65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.588617:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.589011:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.589018:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589027:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.589030:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.589034:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589042:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589061:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589068:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589123:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480328.589625:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.589631:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589640:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.589643:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589663:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589682:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589691:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a3949fd/0xbb972366037fef6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589706:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.589708:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.589709:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.589770:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.589778:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589787:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.589790:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.589794:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589806:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589814:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589823:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.589844:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480328.589917:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.589922:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589932:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.589936:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589945:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589957:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589972:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7ca881e/0xbb972366037fef73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.589988:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.589990:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.589991:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.590487:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.590494:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.590503:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.590507:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.590511:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.590520:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.590529:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.590606:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.590658:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480328.591338:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.591346:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.591354:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.591363:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.591368:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.591378:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.591386:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.591394:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591443:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480328.591449:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591457:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.591466:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591474:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591488:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591496:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003930c2c4/0xbb972366037fef7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591510:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.591513:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591527:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.591531:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591608:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591621:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.591630:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.591632:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.591634:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.591689:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.591695:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3a46362/0xbb972366037fef81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480328.592113:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.592119:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592127:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.592130:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.592134:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592143:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592157:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592165:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.592196:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.592202:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.592209:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.592212:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.592221:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.592233:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.592248:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.592250:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.592252:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.592339:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.592345:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ef561c/0xbb972366037fef88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480328.592918:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.592925:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592934:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.592937:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.592942:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592950:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592958:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.592975:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.593092:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.593097:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.593105:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.593109:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.593117:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.593127:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.593134:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.593136:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.593137:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480328.593192:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480328.593197:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fef8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.593661:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.593838:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.593845:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.593856:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.593859:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.593864:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594034:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594047:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594055:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594086:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789480328.594238:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789480328.594541:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480328.594549:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.594557:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480328.594567:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.594576:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.594591:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.594599:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037fef96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480328.594616:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.594618:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.594620:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480328.594708:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.594715:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594723:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.594726:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.594730:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594739:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594746:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594753:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.594772:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480328.595155:0:19554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480328.595161:0:19554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.595168:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1789480328.595177:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480328.595181:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.595190:0:19554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.595198:0:19554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.595205:0:19554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480328.595228:0:19554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789480328.595274:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480328.595308:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595316:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffe00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480328.595320:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595328:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595340:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595347:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095ec4d68/0xbb972366037fef9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595360:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480328.595363:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595370:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480328.595373:0:19959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595390:0:19959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595401:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595408:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef7b3a6/0xbb972366037fefa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480328.595420:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480328.595422:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480328.595424:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480328.595627:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789480328.596033:0:19554:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1789480328.596167:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18891:x1876405552028672:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51721us (52526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480328.596177:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789480328.598106:0:18891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18891:1876405552028672:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789480328.598123:0:18891:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789480328.598164:0:18891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18891:1876405552028800:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789480328.598209:0:18891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480328.598245:0:18891:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789480328.598340:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028800 00000100:00100000:1.0:1789480328.598347:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028800 00000100:00100000:1.0:1789480328.598395:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480328.598404:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18891:x1876405552028800:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789480328.598445:0:19551:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1789480328.604387:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18891:x1876405552028800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5976us (6170us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789480328.604401:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789480328.604672:0:18891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18891:1876405552028800:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789480328.604688:0:18891:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000001:00100000:2.0:1789480329.219149:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789480329.219165:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:1.0:1789480329.500799:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480330.524540:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789480331.215385:0:20631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789480331.552581:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480331.996250:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789480332.572868:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480333.595426:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480333.659317:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480333.659388:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480333.659442:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552028928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480333.659475:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480333.659592:0:19556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029056 00000100:00100000:2.0:1789480333.659599:0:19556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029056 00000100:00100000:2.0:1789480333.659645:0:19556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552028928 00000100:00100000:2.0:1789480333.659648:0:19556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552028928 00000100:00100000:2.0:1789480333.659675:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480333.659685:0:19556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552029056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480333.659726:0:19556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480333.659953:0:19556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552029056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 270us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480333.659961:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480333.659977:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789480333.659984:0:19556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552028928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480333.660006:0:19556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480333.660035:0:19556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552028928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480333.660041:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789480333.660071:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480333.660075:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480333.660099:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789480333.660123:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480333.660136:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552028928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480333.660852:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552029312:0@lo:400:kworker.0 00000100:00100000:1.0:1789480333.660906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480333.660934:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480333.660940:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552029440:0@lo:400:kworker.0 00000100:00100000:1.0:1789480333.660960:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480333.660992:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029312 00000100:00100000:1.0:1789480333.660996:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029312 00000100:00100000:1.0:1789480333.661030:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029440 00000100:00100000:1.0:1789480333.661033:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029440 00000100:00100000:1.0:1789480333.661057:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789480333.661063:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552029312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480333.661100:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552029312:12345-0@lo:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480333.661107:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789480333.661121:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480333.661128:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552029440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480333.661153:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552029440:12345-0@lo:400:kworker.0 Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480333.661160:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789480333.661176:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789480333.661196:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd786a00 x1876405552029440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480333.661208:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552029440:0@lo:400:kworker.0 00010000:00080000:1.0:1789480333.661217:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd784380 x1876405552029312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480333.661241:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552029312:0@lo:400:kworker.0 00000100:00100000:0.0:1789480333.661643:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552029184:0@lo:400:kworker.0 00000100:00100000:0.0:1789480333.661681:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480333.661694:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405552029568:0@lo:400:kworker.0 00000100:00100000:3.0:1789480333.661726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480333.661729:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029184 00000100:00100000:0.0:1789480333.661734:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029184 00000100:00100000:3.0:1789480333.661769:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029568 00000100:00100000:3.0:1789480333.661772:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029568 00000100:00100000:3.0:1789480333.661826:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480333.661833:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405552029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480333.661879:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405552029568:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480333.661886:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789480333.661904:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789480333.661921:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd786300 x1876405552029568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480333.661947:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405552029568:0@lo:400:kworker.0 00000100:00100000:0.0:1789480333.661948:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789480333.662153:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552029184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480333.662199:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552029184:12345-0@lo:400:kworker.0 Request processed in 49us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480333.662205:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789480333.663930:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552029184:0@lo:400:kworker.0 00000100:00100000:0.0:1789480334.073072:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.073200:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862336 00000100:00100000:2.0:1789480334.073219:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862336 00000100:00100000:2.0:1789480334.073327:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1789480334.073338:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2344:x1876405526862336:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789480334.073376:0:18858:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 06cd89dd-ad1d-496d-8cbb-a8af99c47bc5@192.168.204.54@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1789480334.073419:0:18858:0:(genops.c:1384:class_connect()) connect: client 06cd89dd-ad1d-496d-8cbb-a8af99c47bc5, cookie 0xbb972366037fefab 00000100:00080000:2.0:1789480334.073587:0:18858:0:(import.c:65:import_set_state_nolock()) ffff8d22ba11c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480334.073740:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+5:2344:x1876405526862336:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 339us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480334.073783:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:0.0:1789480334.094015:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.094185:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862464 00000100:00100000:2.0:1789480334.094197:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862464 00000100:00100000:2.0:1789480334.094259:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:2.0:1789480334.094271:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+5:16755:x1876405526862464:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480334.094322:0:18861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480334.094342:0:18861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22baffe000/0xbb972366037fefb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3712 expref: -99 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480334.094370:0:18861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffe000/0xbb972366037fefb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3712 expref: 6 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480334.094381:0:18861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22baffe000/0xbb972366037fefb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3712 expref: 6 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480334.094391:0:18861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe000, rc 0) 00000100:00100000:2.0:1789480334.094457:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+6:16755:x1876405526862464:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 188us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480334.094464:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1789480334.106594:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.109619:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862592 00000100:00100000:0.0:1789480334.109633:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862592 00000100:00100000:0.0:1789480334.109711:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:0.0:1789480334.109722:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+6:16755:x1876405526862592:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789480334.111044:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+6:16755:x1876405526862592:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1317us (4456us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480334.111056:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1789480334.121042:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.121144:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862720 00000100:00100000:0.0:1789480334.121157:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862720 00000100:00100000:0.0:1789480334.121711:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1789480334.121725:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+6:16755:x1876405526862720:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789480334.121743:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480334.121762:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185228200/0xbb972366037fefb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3719 expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480334.122121:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228200/0xbb972366037fefb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3719 expref: 7 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480334.122135:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185228200/0xbb972366037fefb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3719 expref: 7 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480334.122144:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228200, rc 0) 00000100:00100000:1.0:1789480334.122373:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+7:16755:x1876405526862720:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 651us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.122381:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789480334.125764:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.126119:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862848 00000100:00100000:0.0:1789480334.126129:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862848 00000100:00100000:2.0:1789480334.126489:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:2.0:1789480334.126619:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+7:16755:x1876405526862848:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789480334.127178:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16755:x1876405526862848:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 676us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480334.127187:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1789480334.131503:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480334.131671:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526862976 00000100:00100000:1.0:1789480334.131682:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526862976 00000100:00100000:1.0:1789480334.131735:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1789480334.131744:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16755:x1876405526862976:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789480334.132338:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16755:x1876405526862976:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 591us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.132347:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1789480334.142209:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.142746:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863104 00000100:00100000:2.0:1789480334.142762:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863104 00000100:00100000:2.0:1789480334.142883:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1789480334.142895:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16774:x1876405526863104:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480334.143320:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16774:x1876405526863104:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 388us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480334.143331:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1789480334.172586:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480334.172796:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863232 00000100:00100000:3.0:1789480334.172807:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863232 00000100:00100000:3.0:1789480334.172857:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:3.0:1789480334.172867:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16774:x1876405526863232:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789480334.173808:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16774:x1876405526863232:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 938us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480334.173819:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1789480334.203004:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.203707:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863360 00000100:00100000:0.0:1789480334.203718:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863360 00000100:00100000:0.0:1789480334.203790:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1789480334.203799:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+8:16755:x1876405526863360:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789480334.203831:0:18861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480334.203850:0:18861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185228800/0xbb972366037fefc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3743 expref: -99 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480334.203881:0:18861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228800/0xbb972366037fefc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3743 expref: 9 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480334.203892:0:18861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185228800/0xbb972366037fefc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3743 expref: 9 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480334.203901:0:18861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228800, rc 0) 00000100:00100000:0.0:1789480334.204017:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+9:16755:x1876405526863360:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 218us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480334.204024:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:1.0:1789480334.218042:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480334.218821:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863488 00000100:00100000:3.0:1789480334.218832:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863488 00000100:00100000:3.0:1789480334.218884:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1789480334.218896:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+9:16755:x1876405526863488:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789480334.218927:0:18858:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789480334.218956:0:18858:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789480334.218961:0:18858:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789480334.218964:0:18858:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789480334.218966:0:18858:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1789480334.227953:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+9:16755:x1876405526863488:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 9045us (9910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480334.227970:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1789480334.238582:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480334.238685:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863616 00000100:00100000:1.0:1789480334.238697:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863616 00000100:00100000:1.0:1789480334.238755:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1789480334.238789:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+9:16755:x1876405526863616:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789480334.238808:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480334.238827:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f374a expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480334.238856:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 10 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480334.238866:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 10 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480334.238874:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c600, rc 0) 00000100:00100000:1.0:1789480334.238936:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16755:x1876405526863616:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 148us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.238944:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1789480334.245390:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480334.245547:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863744 00000100:00100000:3.0:1789480334.245570:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863744 00000100:00100000:3.0:1789480334.245623:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:3.0:1789480334.245632:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16755:x1876405526863744:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789480334.245954:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16755:x1876405526863744:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 321us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480334.245962:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1789480334.259806:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.260231:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526863872 00000100:00100000:0.0:1789480334.260241:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526863872 00000100:00100000:0.0:1789480334.260344:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:0.0:1789480334.260354:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16755:x1876405526863872:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789480334.260642:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16755:x1876405526863872:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 289us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480334.260651:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:2.0:1789480334.265385:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.266720:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864000 00000100:00100000:0.0:1789480334.266733:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864000 00000100:00100000:0.0:1789480334.266815:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1789480334.266936:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16778:x1876405526864000:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480334.267742:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16778:x1876405526864000:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 915us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480334.267760:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1789480334.293788:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480334.293963:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864128 00000100:00100000:3.0:1789480334.293974:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864128 00000100:00100000:3.0:1789480334.294032:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:3.0:1789480334.294042:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16778:x1876405526864128:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789480334.294377:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16778:x1876405526864128:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 333us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480334.294387:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:2.0:1789480334.310197:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.310331:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864256 00000100:00100000:0.0:1789480334.310342:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864256 00000100:00100000:0.0:1789480334.310396:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789480334.310404:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2344:x1876405526864256:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789480334.310432:0:18866:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1263c5af-228e-4a90-85e8-997aefc2ec3b@192.168.204.54@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:0.0:1789480334.310485:0:18866:0:(genops.c:1384:class_connect()) connect: client 1263c5af-228e-4a90-85e8-997aefc2ec3b, cookie 0xbb972366037fefce 00000004:00100000:0.0:1789480334.310515:0:18866:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789480334.310521:0:18866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1789480334.482778:0:18866:0:(import.c:65:import_set_state_nolock()) ffff8d2283305000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480334.485788:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2344:x1876405526864256:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 175352us (175570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.485810:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789480334.491979:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480334.492159:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480334.493796:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864384 00000100:00100000:1.0:1789480334.493815:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864384 00000100:00100000:1.0:1789480334.493958:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864512 00000100:00100000:1.0:1789480334.493962:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864512 00000100:00100000:1.0:1789480334.494068:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789480334.494082:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:0:x1876405526864384:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789480334.494145:0:18867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1789480334.497080:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480334.497548:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:0:x1876405526864384:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 3457us (5572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.497577:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789480334.497626:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789480334.497637:0:18868:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789480334.497642:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16755:x1876405526864512:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789480334.498048:0:18867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789480334.498207:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16755:x1876405526864512:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 570us (6046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.498215:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789480334.499092:0:18868:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789480334.502940:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.505122:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864640 00000100:00100000:2.0:1789480334.505136:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864640 00000100:00100000:2.0:1789480334.505225:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789480334.505237:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16755:x1876405526864640:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789480334.505385:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16755:x1876405526864640:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 150us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480334.505393:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789480334.509432:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.509481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.509523:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480334.509571:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864768 00000100:00100000:2.0:1789480334.509585:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864768 00000100:00100000:1.0:1789480334.509596:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526864896 00000100:00100000:1.0:1789480334.509612:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526864896 00000100:00100000:2.0:1789480334.509648:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1789480334.509661:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1876405526864768:12345-192.168.204.54@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789480334.509688:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789480334.509700:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1876405526864896:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789480334.509709:0:19554:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1263c5af-228e-4a90-85e8-997aefc2ec3b@192.168.204.54@tcp t0 exp 0000000000000000 cur 627 last 0 00010000:00080000:1.0:1789480334.509740:0:19955:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1263c5af-228e-4a90-85e8-997aefc2ec3b@192.168.204.54@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1789480334.509757:0:19554:0:(genops.c:1384:class_connect()) connect: client 1263c5af-228e-4a90-85e8-997aefc2ec3b, cookie 0xbb972366037fefd5 00000020:00000080:1.0:1789480334.509810:0:19955:0:(genops.c:1384:class_connect()) connect: client 1263c5af-228e-4a90-85e8-997aefc2ec3b, cookie 0xbb972366037fefdc 00002000:00100000:2.0:1789480334.509812:0:19554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1263c5af-228e-4a90-85e8-997aefc2ec3b/ffff8d2286ffd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480334.509831:0:19955:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1263c5af-228e-4a90-85e8-997aefc2ec3b/ffff8d22a02d5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480334.509845:0:19955:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789480334.510169:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865024 00000100:00100000:3.0:1789480334.510177:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865024 00000100:00100000:3.0:1789480334.510224:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480334.510233:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16755:x1876405526865024:12345-192.168.204.54@tcp:33:mount.lustre.0 00002000:00080000:1.0:1789480334.510556:0:19955:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789480334.510595:0:19955:0:(import.c:65:import_set_state_nolock()) ffff8d22c1e91000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480334.510669:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2344:x1876405526864896:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 969us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480334.510677:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00002000:00100000:2.0:1789480334.511929:0:19554:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789480334.513649:0:19554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789480334.513717:0:19554:0:(import.c:65:import_set_state_nolock()) ffff8d22a0284800 : changing import state from RECOVER to FULL 00000004:00080000:1.0:1789480334.514253:0:18869:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3919us 00000100:00100000:2.0:1789480334.515215:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2344:x1876405526864768:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 5542us (5719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480334.515233:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000004:00200000:0.0:1789480334.530918:0:18869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789480334.531123:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16755:x1876405526865024:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 20882us (21700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480334.531141:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00010000:00010000:1.0:1789480334.624931:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789480334.735375:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1263c5af-228e-4a90-85e8-997aefc2ec3b 00000100:00100000:1.0:1789480334.860167:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480334.860322:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865152 00000100:00100000:3.0:1789480334.860337:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865152 00000100:00100000:3.0:1789480334.860411:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789480334.860424:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16799:x1876405526865152:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:3.0:1789480334.860453:0:18868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480334.860486:0:18868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fefe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3774 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480334.860596:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fefea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480334.860615:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fefea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480334.860633:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fefea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480334.860680:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480334.860684:0:18868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480334.860732:0:18868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fefea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480334.860774:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fefe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3774 expref: 8 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480334.860795:0:18868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fefea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3774 expref: 7 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480334.860804:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480334.860807:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480334.860811:0:18868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4200, rc 0) 00000100:00100000:3.0:1789480334.860962:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:16799:x1876405526865152:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 540us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480334.860971:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1789480335.642677:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480336.669418:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480337.205368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480337.205849:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865280 00000100:00100000:1.0:1789480337.205862:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865280 00000100:00100000:1.0:1789480337.205952:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1789480337.205963:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:16851:x1876405526865280:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:1.0:1789480337.206021:0:18867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789480337.206143:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:16851:x1876405526865280:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 182us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480337.206151:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:0.0:1789480337.207389:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480337.217029:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480337.217412:0:19556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865408 00000100:00100000:2.0:1789480337.217427:0:19556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865408 00000100:00100000:2.0:1789480337.219064:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789480337.219097:0:19556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:16851:x1876405526865408:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:2.0:1789480337.219163:0:19556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480337.219321:0:19556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:16851:x1876405526865408:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 241us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480337.219330:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00080000:0.0:1789480337.220221:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480337.225701:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480337.225816:0:19556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865536 00000100:00100000:1.0:1789480337.225829:0:19556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865536 00000100:00100000:1.0:1789480337.225912:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1789480337.225923:0:19556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16851:x1876405526865536:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:1.0:1789480337.225976:0:19556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480337.226082:0:19556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:16851:x1876405526865536:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 161us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480337.226098:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00080000:0.0:1789480337.226788:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480337.464018:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480337.465177:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865664 00000100:00100000:0.0:1789480337.465189:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865664 00000100:00100000:0.0:1789480337.465266:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:0.0:1789480337.465278:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+10:16885:x1876405526865664:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789480337.465321:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480337.465341:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185228c00/0xbb972366037feff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f377b expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.465405:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228c00/0xbb972366037feff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f377b expref: 11 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.465417:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185228c00/0xbb972366037feff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f377b expref: 11 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.465427:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228c00, rc 0) 00000100:00100000:0.0:1789480337.465504:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16885:x1876405526865664:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 229us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480337.465521:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789480337.469040:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480337.469423:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865792 00000100:00100000:2.0:1789480337.469433:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865792 00000100:00100000:2.0:1789480337.469494:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:2.0:1789480337.469505:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218769e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16885:x1876405526865792:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789480337.469889:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218769e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16885:x1876405526865792:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 386us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480337.469897:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:2.0:1789480337.475613:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.482383:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526865920 00000100:00100000:3.0:1789480337.482528:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526865920 00000100:00100000:3.0:1789480337.482610:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1789480337.482620:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16885:x1876405526865920:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789480337.483487:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16885:x1876405526865920:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 865us (7891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.483497:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1789480337.504789:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480337.515215:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866048 00000100:00100000:0.0:1789480337.515231:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866048 00000100:00100000:0.0:1789480337.515404:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1789480337.515415:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16891:x1876405526866048:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480337.515801:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16891:x1876405526866048:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 387us (11021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480337.515810:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:1.0:1789480337.542261:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.542388:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866176 00000100:00100000:3.0:1789480337.542399:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866176 00000100:00100000:3.0:1789480337.542459:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:3.0:1789480337.542471:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16891:x1876405526866176:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789480337.542805:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16891:x1876405526866176:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 335us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.542813:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1789480337.549404:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480337.549958:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866304 00000100:00100000:0.0:1789480337.549968:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866304 00000100:00100000:0.0:1789480337.550023:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:0.0:1789480337.550034:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16885:x1876405526866304:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789480337.550051:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480337.550069:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185228000/0xbb972366037feff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37a5 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.550100:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228000/0xbb972366037feff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37a5 expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.550129:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185228000/0xbb972366037feff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37a5 expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.550139:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228000, rc 0) 00000100:00100000:0.0:1789480337.551117:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16885:x1876405526866304:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 1080us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480337.551126:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:0.0:1789480337.557688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480337.557807:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866432 00000100:00100000:2.0:1789480337.557832:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866432 00000100:00100000:2.0:1789480337.557894:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:2.0:1789480337.557906:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16885:x1876405526866432:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789480337.557934:0:18861:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789480337.557953:0:18861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789480337.557957:0:18861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789480337.557960:0:18861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789480337.557962:0:18861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1789480337.560416:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16885:x1876405526866432:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 2503us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480337.560429:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1789480337.574420:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480337.574519:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866560 00000100:00100000:0.0:1789480337.574538:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866560 00000100:00100000:0.0:1789480337.574601:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:0.0:1789480337.574612:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16885:x1876405526866560:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789480337.574631:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480337.574649:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37ac expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.574679:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 13 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.574691:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 13 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480337.574711:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229c00, rc 0) 00000100:00100000:0.0:1789480337.574782:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16885:x1876405526866560:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480337.574790:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:0.0:1789480337.580143:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480337.580257:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866688 00000100:00100000:2.0:1789480337.580268:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866688 00000100:00100000:2.0:1789480337.580360:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1789480337.580370:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16885:x1876405526866688:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789480337.581041:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16885:x1876405526866688:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 671us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480337.581049:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1789480337.583843:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.583946:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866816 00000100:00100000:3.0:1789480337.583956:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866816 00000100:00100000:3.0:1789480337.584015:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1789480337.584025:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16885:x1876405526866816:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789480337.584383:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16885:x1876405526866816:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 359us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.584392:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:1.0:1789480337.589881:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480337.590103:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526866944 00000100:00100000:2.0:1789480337.590113:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526866944 00000100:00100000:2.0:1789480337.590173:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:2.0:1789480337.590184:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16896:x1876405526866944:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480337.597666:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16896:x1876405526866944:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 7469us (7781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480337.597682:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789480337.609103:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480337.609229:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867072 00000100:00100000:0.0:1789480337.609239:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867072 00000100:00100000:3.0:1789480337.609332:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1789480337.609345:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16896:x1876405526867072:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789480337.609623:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16896:x1876405526867072:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.621024:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:1.0:1789480337.621249:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480337.621321:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867200 00000100:00100000:2.0:1789480337.621343:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867200 00000100:00100000:2.0:1789480337.621393:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789480337.621401:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2344:x1876405526867200:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789480337.621430:0:18866:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1d3d6d55-1b4d-481a-820a-bd754766c9b2@192.168.204.54@tcp t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:2.0:1789480337.621465:0:18866:0:(genops.c:1384:class_connect()) connect: client 1d3d6d55-1b4d-481a-820a-bd754766c9b2, cookie 0xbb972366037ff006 00000004:00100000:2.0:1789480337.621496:0:18866:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789480337.622421:0:18866:0:(import.c:65:import_set_state_nolock()) ffff8d22a0280000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480337.622500:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2344:x1876405526867200:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 1097us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480337.622509:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789480337.633886:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.633978:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867328 00000100:00100000:3.0:1789480337.633989:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867328 00000100:00100000:3.0:1789480337.634078:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480337.634089:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:0:x1876405526867328:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789480337.634122:0:18867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789480337.634215:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:0:x1876405526867328:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 127us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.634224:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:0.0:1789480337.634250:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480337.636951:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.637050:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867456 00000100:00100000:3.0:1789480337.637059:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867456 00000100:00100000:3.0:1789480337.637123:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1789480337.637144:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16885:x1876405526867456:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789480337.637173:0:18868:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789480337.637253:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16885:x1876405526867456:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.637261:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789480337.639831:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.639914:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867584 00000100:00100000:3.0:1789480337.639924:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867584 00000100:00100000:3.0:1789480337.639992:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789480337.640002:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16885:x1876405526867584:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789480337.640094:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16885:x1876405526867584:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.640101:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480337.654718:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480337.654763:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480337.654847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.654914:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867968 00000100:00100000:3.0:1789480337.654926:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867968 00000100:00100000:3.0:1789480337.654992:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1789480337.655004:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16885:x1876405526867968:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789480337.655091:0:18870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789480337.655184:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16885:x1876405526867968:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.655192:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789480337.663459:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867712 00000100:00100000:0.0:1789480337.663539:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867712 00000100:00100000:0.0:1789480337.663611:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526867840 00000100:00100000:0.0:1789480337.663615:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526867840 00000100:00100000:0.0:1789480337.663649:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480337.663659:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1876405526867712:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789480337.663693:0:19553:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1d3d6d55-1b4d-481a-820a-bd754766c9b2@192.168.204.54@tcp t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:0.0:1789480337.663738:0:19553:0:(genops.c:1384:class_connect()) connect: client 1d3d6d55-1b4d-481a-820a-bd754766c9b2, cookie 0xbb972366037ff00d 00002000:00100000:0.0:1789480337.663750:0:19553:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1d3d6d55-1b4d-481a-820a-bd754766c9b2/ffff8d218560d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789480337.663762:0:19553:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789480337.664010:0:19553:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789480337.664047:0:19553:0:(import.c:65:import_set_state_nolock()) ffff8d218560f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480337.664132:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2344:x1876405526867712:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 473us (9367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480337.664140:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480337.664161:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789480337.664166:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1876405526867840:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789480337.664265:0:19553:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1d3d6d55-1b4d-481a-820a-bd754766c9b2@192.168.204.54@tcp t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:0.0:1789480337.664305:0:19553:0:(genops.c:1384:class_connect()) connect: client 1d3d6d55-1b4d-481a-820a-bd754766c9b2, cookie 0xbb972366037ff014 00002000:00100000:0.0:1789480337.664311:0:19553:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1d3d6d55-1b4d-481a-820a-bd754766c9b2/ffff8d218560e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789480337.664319:0:19553:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789480337.664378:0:19553:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789480337.664393:0:19553:0:(import.c:65:import_set_state_nolock()) ffff8d218560f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480337.664419:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2344:x1876405526867840:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 251us (9572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480337.664425:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:1.0:1789480337.691019:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480337.878494:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480337.878761:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868096 00000100:00100000:3.0:1789480337.878780:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868096 00000100:00100000:3.0:1789480337.878839:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480337.878849:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:16917:x1876405526868096:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:3.0:1789480337.878870:0:18868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480337.878889:0:18868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037ff01b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37d6 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480337.878954:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480337.878969:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480337.878982:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480337.879017:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480337.879021:0:18868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480337.879038:0:18868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480337.879083:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037ff01b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 8 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480337.879103:0:18868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 7 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480337.879111:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480337.879115:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480337.879118:0:18868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5000, rc 0) 00000100:00100000:3.0:1789480337.879543:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+7:16917:x1876405526868096:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 693us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480337.879551:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:1.0:1789480338.715197:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480338.778928:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480338.778956:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552029696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480338.779054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480338.779151:0:19556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029696 00000100:00100000:1.0:1789480338.779160:0:19556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029696 00000100:00100000:1.0:1789480338.779226:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480338.779235:0:19556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552029696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480338.779262:0:19556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480338.779333:0:19556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552029696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480338.779341:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789480338.779364:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480338.779399:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552029696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480338.779926:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552030208:0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.779967:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480338.780009:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480338.780015:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552030080:0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.780038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480338.780085:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030208 00000100:00100000:2.0:1789480338.780090:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030208 00000100:00100000:2.0:1789480338.780128:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030080 00000100:00100000:2.0:1789480338.780131:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030080 00000100:00100000:2.0:1789480338.780151:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480338.780157:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552030208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.780195:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552030208:12345-0@lo:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480338.780202:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480338.780216:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789480338.780238:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552030080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.780268:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552030080:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480338.780274:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789480338.780321:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480338.780344:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552030080:0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.780355:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552030208:0@lo:400:kworker.0 00000100:00100000:1.0:1789480338.782699:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552029824:0@lo:400:kworker.0 00000100:00100000:1.0:1789480338.782776:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480338.782837:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552030336:0@lo:400:kworker.0 00000100:00100000:1.0:1789480338.782865:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480338.782909:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480338.782916:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552029952:0@lo:400:kworker.0 00000100:00100000:1.0:1789480338.782957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480338.783318:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030336 00000100:00100000:3.0:1789480338.783326:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030336 00000100:00100000:3.0:1789480338.783395:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789480338.783404:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552030336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480338.783501:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480338.783544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480338.783580:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029952 00000100:00100000:1.0:1789480338.783584:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029952 00000100:00100000:1.0:1789480338.783619:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480338.783627:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552029952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.785360:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552029824 00000100:00100000:2.0:1789480338.785370:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552029824 00000100:00100000:2.0:1789480338.785423:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789480338.785430:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3298:x1876405552029824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480338.788044:0:19556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030464 00000100:00100000:0.0:1789480338.788063:0:19556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030464 00000100:00100000:0.0:1789480338.788144:0:19556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789480338.788153:0:19556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405552030464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480338.788182:0:19556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480338.788264:0:19556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405552030464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480338.788271:0:19556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480338.797542:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552030336:12345-0@lo:400:kworker.0 Request processed in 14109us (14644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480338.797563:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789480338.797816:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480338.797823:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480338.810343:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552029952:12345-0@lo:400:kworker.0 Request processed in 26703us (27370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480338.810360:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480338.810444:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480338.811469:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552029952:0@lo:400:kworker.0 00000100:00100000:2.0:1789480338.812340:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3298:x1876405552029824:12345-0@lo:400:kworker.0 Request processed in 26906us (29560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480338.812354:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789480338.823923:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552029824:0@lo:400:kworker.0 00000100:00100000:1.0:1789480338.833818:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552030336:0@lo:400:kworker.0 00000001:00100000:0.0:1789480339.374483:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d3d6d55-1b4d-481a-820a-bd754766c9b2 00000001:00100000:0.0:1789480339.374502:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1263c5af-228e-4a90-85e8-997aefc2ec3b 00010000:00010000:1.0:1789480339.738805:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789480339.915071:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d3d6d55-1b4d-481a-820a-bd754766c9b2 00000001:00100000:1.0:1789480339.932690:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1263c5af-228e-4a90-85e8-997aefc2ec3b 00000001:00100000:1.0:1789480339.932889:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d3d6d55-1b4d-481a-820a-bd754766c9b2 00010000:00010000:2.0:1789480340.771107:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480341.214206:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789480341.541251:0:20837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789480341.786496:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480342.810795:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480342.902554:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902647:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902673:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902691:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902713:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902736:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480342.902766:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868608 00000100:00100000:0.0:1789480342.902789:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868608 00000100:00100000:0.0:1789480342.902840:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868864 00000100:00100000:0.0:1789480342.902843:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868864 00000100:00100000:0.0:1789480342.902873:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868480 00000100:00100000:0.0:1789480342.902876:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868480 00000100:00100000:0.0:1789480342.902889:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868992 00000100:00100000:0.0:1789480342.902892:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868992 00000100:00100000:0.0:1789480342.902908:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789480342.902919:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526868608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480342.902999:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526868608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480342.903006:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789480342.903023:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789480342.903030:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526868864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480342.903054:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526868864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480342.903059:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789480342.903069:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480342.903076:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526868480:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480342.903096:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526868480:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480342.903102:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480342.903114:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480342.903121:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526868992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480342.903141:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526868992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480342.903153:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1789480342.903613:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868352 00000100:00100000:3.0:1789480342.903619:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868352 00000100:00100000:3.0:1789480342.903660:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868736 00000100:00100000:3.0:1789480342.903664:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868736 00000100:00100000:3.0:1789480342.903696:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480342.903704:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2348:x1876405526868352:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480342.903757:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2348:x1876405526868352:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 55us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480342.903763:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480342.903780:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480342.903787:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2348:x1876405526868736:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480342.903811:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2348:x1876405526868736:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480342.903817:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480342.903839:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526868224 00000100:00100000:3.0:1789480342.903843:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526868224 00000100:00100000:3.0:1789480342.903882:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1789480342.903889:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:2348:x1876405526868224:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480342.903914:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:2348:x1876405526868224:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480342.903920:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00080000:3.0:1789480342.903948:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480342.903952:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480342.903954:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789480343.835708:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480343.898642:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552030848:0@lo:400:kworker.0 00000100:00100000:1.0:1789480343.898715:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480343.898779:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480343.898786:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552030976:0@lo:400:kworker.0 00000100:00100000:1.0:1789480343.898812:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480343.898843:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030848 00000100:00100000:1.0:1789480343.898863:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030848 00000100:00100000:1.0:1789480343.898929:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480343.898937:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552030848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480343.898988:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552030848:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480343.898995:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480343.899033:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552030848:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.899157:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552030720:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.899213:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480343.899239:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552031232:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.899261:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480343.899310:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789480343.899317:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552030592:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.899347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480343.899380:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552031104:0@lo:400:kworker.0 00000100:00100000:1.0:1789480343.899559:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030720 00000100:00100000:1.0:1789480343.899563:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030720 00000100:00100000:1.0:1789480343.899601:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480343.899608:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552030720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480343.899642:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552030720:12345-0@lo:400:kworker.0 Request processed in 35us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480343.899648:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480343.899702:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552031360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480343.899725:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480343.899741:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480343.899746:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552031488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480343.899763:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480343.900343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480343.900391:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552030720:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.900425:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030976 00000100:00100000:3.0:1789480343.900428:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030976 00000100:00100000:3.0:1789480343.900457:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552031232 00000100:00100000:3.0:1789480343.900460:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552031232 00000100:00100000:3.0:1789480343.900472:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552031104 00000100:00100000:3.0:1789480343.900475:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552031104 00000100:00100000:3.0:1789480343.900488:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480343.900494:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.900533:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552030976:12345-0@lo:400:kworker.0 Request processed in 39us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480343.900539:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480343.900553:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789480343.900558:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552031232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.900601:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552031232:12345-0@lo:400:kworker.0 Request processed in 42us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480343.900606:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789480343.900618:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789480343.900623:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552031104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.900649:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552031104:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480343.900655:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789480343.900672:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480343.900677:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480343.900678:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480343.900712:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552030592 00000100:00100000:3.0:1789480343.900716:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552030592 00000100:00100000:3.0:1789480343.900740:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789480343.900747:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552030592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.900778:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552030592:12345-0@lo:400:kworker.0 Request processed in 32us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480343.900784:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789480343.900815:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552031360 00000100:00100000:3.0:1789480343.900818:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552031360 00000100:00100000:3.0:1789480343.900835:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552031488 00000100:00100000:3.0:1789480343.900837:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552031488 00000100:00100000:3.0:1789480343.900847:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480343.900852:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552031360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480343.900893:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480343.900934:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552031360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480343.900939:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480343.900951:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480343.900957:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552031488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480343.900975:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480343.901005:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552031488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480343.901010:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480343.901048:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552031488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480343.901058:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552031360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480343.901067:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552030976:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.901107:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552030592:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.901116:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552031104:0@lo:400:kworker.0 00000100:00100000:3.0:1789480343.901124:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552031232:0@lo:400:kworker.0 00010000:00010000:1.0:1789480344.858629:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480345.884655:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789480346.816018:0:20985:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcab2d90a0 20000000:00000080:2.0:1789480346.816035:0:20985:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d218516ac00 uarg=0000000000000000 20000000:01000000:2.0:1789480346.816073:0:20985:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789480346.816079:0:20985:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789480346.816083:0:20985:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789480346.829138:0:20986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789480346.829323:0:20985:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789480346.848022:0:20985:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789480346.848382:0:20985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848400:0:20985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fece1 expref: 18 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848407:0:20985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fed2e expref: 18 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848429:0:20985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fee7e expref: 18 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848438:0:20985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848445:0:20985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848451:0:20985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848500:0:20985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848516:0:20985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 12 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.848577:0:20985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552031616:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480346.848696:0:20985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 12 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848704:0:20985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 12 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.848713:0:20985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552031744:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480346.848744:0:20985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fee7e expref: 18 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848763:0:20985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fee7e expref: 18 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.848772:0:20985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552031872:0@lo:104: 00000100:00100000:1.0:1789480346.848813:0:20985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480346.848854:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552031872 00000100:00100000:1.0:1789480346.848861:0:18850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552031872 00000100:00100000:1.0:1789480346.848911:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789480346.848919:0:18850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:20985:x1876405552031872:12345-0@lo:104: 00010000:00010000:1.0:1789480346.848932:0:18850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.848993:0:18850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480346.848999:0:18850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:20985:x1876405552031872:12345-0@lo:104: Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480346.849006:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789480346.849032:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480346.849037:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849044:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480346.849047:0:18854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849056:0:18854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480346.849062:0:18854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480346.849074:0:18854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480346.849116:0:18854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849122:0:18854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480346.849144:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849150:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fee7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fee85 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849163:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480346.849165:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480346.849166:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480346.849185:0:20985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fed2e expref: 18 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849193:0:20985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fed2e expref: 18 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.849202:0:20985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552032128:0@lo:104: 00000100:00100000:1.0:1789480346.849224:0:20985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480346.849243:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032128 00000100:00100000:1.0:1789480346.849247:0:18850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032128 00000100:00100000:1.0:1789480346.849269:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480346.849275:0:18850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:20985:x1876405552032128:12345-0@lo:104: 00010000:00010000:1.0:1789480346.849308:0:18850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849373:0:18850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480346.849379:0:18850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:20985:x1876405552032128:12345-0@lo:104: Request processed in 105us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480346.849385:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789480346.849399:0:18855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480346.849403:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849409:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646800 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480346.849412:0:18855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849419:0:18855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480346.849425:0:18855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480346.849429:0:18855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480346.849444:0:18855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849449:0:18855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480346.849455:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849460:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2187646800/0xbb972366037fed2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fed35 expref: -99 pid: 19550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849479:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480346.849480:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480346.849482:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480346.849508:0:20985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fece1 expref: 18 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849517:0:20985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fece1 expref: 18 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.849536:0:20985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552032384:0@lo:104: 00000100:00100000:1.0:1789480346.849561:0:20985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480346.849589:0:18850:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789480346.849598:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032384 00000100:00100000:1.0:1789480346.849601:0:18850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032384 00000100:00100000:1.0:1789480346.849621:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480346.849626:0:18850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d21873d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:20985:x1876405552032384:12345-0@lo:104: 00010000:00010000:1.0:1789480346.849633:0:18850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.849662:0:18850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480346.849667:0:18850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d21873d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2016df8a-d509-4535-998f-23fecb5de199+3:20985:x1876405552032384:12345-0@lo:104: Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480346.849673:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480346.849715:0:20985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c24480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480346.849737:0:20985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552031872:0@lo:104: 00000100:00100000:1.0:1789480346.849745:0:20985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552032128:0@lo:104: 00000100:00100000:1.0:1789480346.849751:0:20985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552032384:0@lo:104: 00000100:00100000:0.0:1789480346.850399:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552032000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480346.850440:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480346.850465:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480346.850471:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552032256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480346.850490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480346.850514:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032000 00000100:00100000:0.0:1789480346.850518:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032000 00010000:00010000:0.0:1789480346.850551:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fee7e expref: 19 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480346.850570:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032256 00000100:00100000:0.0:1789480346.850573:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032256 00010000:00010000:0.0:1789480346.850583:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fed2e expref: 20 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480346.850595:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480346.852294:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+20:3300:x1876405552032000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480346.852317:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480346.852326:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fee7e expref: 20 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.852339:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fee7e expref: 20 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.852357:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5600/0xbb972366037fee85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fee7e expref: 20 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.852386:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480346.852451:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+19:3300:x1876405552032000:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480346.852459:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480346.852489:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789480346.852496:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+18:3300:x1876405552032256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480346.852506:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480346.852510:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fed2e expref: 18 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.852518:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fed2e expref: 18 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.852538:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39d600/0xbb972366037fed35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fed2e expref: 18 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.852547:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480346.852570:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+17:3300:x1876405552032256:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480346.852576:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480346.852801:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552032256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480346.852813:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552032000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480346.853198:0:19959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480346.853207:0:19959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.853215:0:19959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480346.853219:0:19959:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.853228:0:19959:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480346.853236:0:19959:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480346.853242:0:19959:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480346.853653:0:19959:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.853661:0:19959:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789480346.853710:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552032512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480346.853759:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480346.853903:0:19959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.853912:0:19959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d400/0xbb972366037fece1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fece8 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.853940:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480346.853942:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480346.853944:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480346.854045:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032512 00000100:00100000:0.0:1789480346.854052:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032512 00010000:00010000:0.0:1789480346.854092:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fece1 expref: 17 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480346.854124:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480346.854130:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+17:3298:x1876405552032512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480346.854147:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480346.854152:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fece1 expref: 17 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.854160:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fece1 expref: 17 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.854171:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fece8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fece1 expref: 17 pid: 18858 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480346.854183:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480346.855469:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2016df8a-d509-4535-998f-23fecb5de199+16:3298:x1876405552032512:12345-0@lo:103:ldlm_bl.0 Request processed in 1332us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480346.855480:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480346.855637:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2016df8a-d509-4535-998f-23fecb5de199:3298:1876405552032512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480346.869368:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480346.869403:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480346.869539:0:18853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869120 00000100:00100000:3.0:1789480346.869548:0:18853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869120 00010000:00010000:3.0:1789480346.869586:0:18853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 13 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480346.869622:0:18853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869248 00000100:00100000:3.0:1789480346.869625:0:18853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869248 00010000:00010000:3.0:1789480346.869636:0:18853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 14 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480346.869650:0:18853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1789480346.869658:0:18853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+14:2348:x1876405526869120:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480346.869672:0:18853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480346.869677:0:18853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 14 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869689:0:18853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 14 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869708:0:18853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480346.869757:0:18853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+14:2348:x1876405526869120:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 99us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480346.869765:0:18853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1789480346.869793:0:18853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789480346.869800:0:18853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:2348:x1876405526869248:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480346.869822:0:18853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480346.869827:0:18853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 13 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869836:0:18853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 13 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869847:0:18853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869856:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869871:0:18853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869878:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869884:0:18853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869890:0:18853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869895:0:18853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39cc00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480346.869899:0:18853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869906:0:18853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869925:0:18853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480346.869935:0:18853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480346.869956:0:18853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:2348:x1876405526869248:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 155us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480346.869961:0:18853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1789480346.870471:0:20985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2185229c00/0xbb972366037fefff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37ac expref: 12 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.870486:0:20985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552031616:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480346.870496:0:20985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39c600/0xbb972366037fefc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f374a expref: 11 pid: 18860 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480346.870504:0:20985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20985:1876405552031744:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480346.870543:0:20985:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.870553:0:20985:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.870559:0:20985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.870566:0:20985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39cc00/0xbb972366037ff029 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480346.907502:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480347.930546:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789480347.930588:0:18863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480347.930592:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2291dbf000 from 10 10000000:01000000:3.0:1789480347.930597:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480347.930642:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.930652:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.930662:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480347.930688:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552032640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.930772:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480347.930820:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22829d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789480347.930959:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032640 00000100:00100000:0.0:1789480347.930967:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032640 00000100:00100000:0.0:1789480347.931021:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789480347.931030:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+16:18863:x1876405552032640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480347.931043:0:18860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480347.931055:0:18860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185228400/0xbb972366037ff037 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037ff030 expref: -99 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480347.931076:0:18860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228400/0xbb972366037ff037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037ff030 expref: 17 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480347.931085:0:18860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185228400/0xbb972366037ff037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037ff030 expref: 17 pid: 18860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480347.931103:0:18860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228400, rc 0) 00000100:00100000:0.0:1789480347.931153:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+17:18863:x1876405552032640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480347.931160:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789480347.931227:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552032640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480347.931258:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff037 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480347.931267:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037ff037 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480347.931341:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552032768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480347.931368:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480347.931405:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032768 00000100:00100000:1.0:1789480347.931405:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c24480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480347.931409:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032768 00000100:00100000:3.0:1789480347.931443:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789480347.931451:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:18863:x1876405552032768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.931819:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:18863:x1876405552032768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480347.931835:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789480347.932102:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552032768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480347.932132:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552032896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480347.932168:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480347.932247:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c24480 going to sleep for 11 seconds 00000100:00100000:2.0:1789480347.932397:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552032896 00000100:00100000:2.0:1789480347.932403:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552032896 00000100:00100000:2.0:1789480347.932482:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789480347.932491:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+17:18863:x1876405552032896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480347.932700:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+17:18863:x1876405552032896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480347.932714:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789480347.932783:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552032896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789480347.935404:0:20998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789480347.935635:0:18863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789480347.935654:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480347.936926:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff037 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.936942:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4800/0xbb972366037ff030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff037 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480347.936955:0:18863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480347.936958:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d229c509800 from 10 10000000:01000000:3.0:1789480347.936961:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480347.937014:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.937022:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.937033:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480347.937059:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.937140:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480347.937192:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22830e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480347.937465:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033024 00000100:00100000:2.0:1789480347.937472:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033024 00000100:00100000:2.0:1789480347.937558:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789480347.937568:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+17:18863:x1876405552033024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480347.937581:0:18861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480347.937593:0:18861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22baffe800/0xbb972366037ff045 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037ff03e expref: -99 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480347.937618:0:18861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffe800/0xbb972366037ff045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037ff03e expref: 18 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480347.937629:0:18861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22baffe800/0xbb972366037ff045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037ff03e expref: 18 pid: 18861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480347.937639:0:18861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe800, rc 0) 00000100:00100000:2.0:1789480347.937698:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552033024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480347.937705:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789480347.937792:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480347.937807:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff045 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.937816:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037ff045 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480347.937881:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.937905:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480347.937943:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22830e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789480347.938092:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033152 00000100:00100000:0.0:1789480347.938097:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033152 00000100:00100000:0.0:1789480347.938129:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789480347.938136:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552033152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480347.938565:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552033152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480347.938571:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789480347.938646:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.938689:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.938728:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480347.938757:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22830e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480347.939047:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033280 00000100:00100000:2.0:1789480347.939052:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033280 00000100:00100000:2.0:1789480347.939087:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789480347.939095:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552033280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480347.939388:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552033280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480347.939397:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789480347.939889:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789480347.940910:0:20999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789480347.941216:0:18863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789480347.941252:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480347.941262:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff045 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.941273:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037ff03e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff045 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480347.941318:0:18863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480347.941322:0:18863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d218785b000 from 10 10000000:01000000:3.0:1789480347.941325:0:18863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480347.941358:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.941367:0:18863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.941377:0:18863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480347.941415:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.941469:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480347.941519:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283755a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480347.941724:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033408 00000100:00100000:2.0:1789480347.941737:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033408 00000100:00100000:2.0:1789480347.941783:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789480347.941793:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+18:18863:x1876405552033408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480347.941805:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480347.941818:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bafff400/0xbb972366037ff053 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037ff04c expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480347.941839:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bafff400/0xbb972366037ff053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037ff04c expref: 19 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480347.941851:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bafff400/0xbb972366037ff053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037ff04c expref: 19 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480347.941860:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff400, rc 0) 00000100:00100000:2.0:1789480347.941899:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552033408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480347.942402:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789480347.942518:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480347.942535:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff053 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480347.942544:0:18863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037ff053 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480347.942611:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480347.942643:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480347.942737:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033536 00000100:00100000:0.0:1789480347.942742:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033536 00000100:00100000:0.0:1789480347.942779:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789480347.942788:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552033536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480347.944796:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552033536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2002us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480347.944809:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789480347.945023:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480347.945049:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480347.945101:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480347.945154:0:18863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480347.945182:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480347.945303:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033664 00000100:00100000:3.0:1789480347.945309:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033664 00000100:00100000:3.0:1789480347.945352:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789480347.945360:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552033664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480347.945555:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2016df8a-d509-4535-998f-23fecb5de199+19:18863:x1876405552033664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480347.945562:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789480347.946554:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2016df8a-d509-4535-998f-23fecb5de199:18863:1876405552033664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480347.950135:0:21000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789480347.950804:0:18863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789480347.950828:0:18863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480347.950839:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff053 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480347.950852:0:18863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4c00/0xbb972366037ff04c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037ff053 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480348.041572:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041635:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041701:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041734:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041757:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041787:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.041826:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869632 00000100:00100000:2.0:1789480348.041840:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869632 00000100:00100000:2.0:1789480348.041943:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870144 00000100:00100000:2.0:1789480348.041947:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870144 00000100:00100000:2.0:1789480348.041966:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869760 00000100:00100000:2.0:1789480348.041969:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869760 00000100:00100000:2.0:1789480348.041984:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870016 00000100:00100000:2.0:1789480348.041986:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870016 00000100:00100000:2.0:1789480348.042003:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789480348.042013:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526869632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480348.042137:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789480348.042165:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526870144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480348.042280:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526869632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 265us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480348.042340:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789480348.042364:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789480348.042372:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526869760:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480348.042438:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869888 00000100:00100000:3.0:1789480348.042444:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869888 00000100:00100000:3.0:1789480348.042480:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869504 00000100:00100000:3.0:1789480348.042483:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869504 00000100:00100000:3.0:1789480348.042520:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789480348.042528:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2348:x1876405526869888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480348.042607:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526869376 00000100:00100000:0.0:1789480348.042611:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526869376 00000100:00100000:0.0:1789480348.042646:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1789480348.042653:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:2348:x1876405526869376:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480348.046051:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526869760:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3655us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480348.046072:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789480348.046140:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1789480348.046158:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526870016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480348.046236:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526870016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (4447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480348.046242:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1789480348.046279:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1789480348.046309:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2348:x1876405526869504:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480348.046342:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2348:x1876405526869504:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480348.046369:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00080000:2.0:1789480348.046628:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480348.046637:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480348.046640:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480348.046872:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2348:x1876405526870144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 4708us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480348.046889:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480348.048364:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2348:x1876405526869888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 5822us (6677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480348.048418:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789480348.048637:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:2348:x1876405526869376:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 5982us (7077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480348.048648:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1789480348.676552:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480348.677125:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870272 00000100:00100000:0.0:1789480348.677141:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870272 00000100:00100000:0.0:1789480348.677226:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1789480348.677238:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+11:16769:x1876405526870272:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480348.677271:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480348.677336:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185228a00/0xbb972366037ff05a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37dd expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480348.677380:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185228a00/0xbb972366037ff05a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37dd expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480348.677394:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185228a00/0xbb972366037ff05a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37dd expref: 12 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480348.677405:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228a00, rc 0) 00000100:00100000:0.0:1789480348.677567:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16769:x1876405526870272:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 330us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480348.677575:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:2.0:1789480348.694459:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480348.694661:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870400 00000100:00100000:0.0:1789480348.694674:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870400 00000100:00100000:0.0:1789480348.694748:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789480348.694761:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16769:x1876405526870400:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480348.695149:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16769:x1876405526870400:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 390us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480348.695158:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789480348.708590:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.708937:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870528 00000100:00100000:2.0:1789480348.708950:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870528 00000100:00100000:2.0:1789480348.709028:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1789480348.709041:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16769:x1876405526870528:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480348.710807:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16769:x1876405526870528:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 1755us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480348.710822:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1789480348.736311:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480348.736785:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870656 00000100:00100000:0.0:1789480348.736800:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870656 00000100:00100000:0.0:1789480348.736902:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1789480348.736915:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+12:16769:x1876405526870656:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480348.736940:0:18858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480348.736964:0:18858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2185229800/0xbb972366037ff061 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37e4 expref: -99 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480348.737002:0:18858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2185229800/0xbb972366037ff061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37e4 expref: 13 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480348.737016:0:18858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2185229800/0xbb972366037ff061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37e4 expref: 13 pid: 18858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480348.737028:0:18858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229800, rc 0) 00000100:00100000:0.0:1789480348.737134:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16769:x1876405526870656:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 222us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480348.737142:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1789480348.764982:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480348.765384:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870784 00000100:00100000:2.0:1789480348.765398:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870784 00000100:00100000:2.0:1789480348.765516:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1789480348.765530:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16769:x1876405526870784:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480348.766040:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16769:x1876405526870784:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 511us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480348.766051:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:1.0:1789480348.777044:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480348.783855:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526870912 00000100:00100000:3.0:1789480348.783876:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526870912 00000100:00100000:3.0:1789480348.783978:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1789480348.783992:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16769:x1876405526870912:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480348.784371:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:16769:x1876405526870912:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 380us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480348.784381:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00010000:00010000:3.0:1789480348.954504:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480349.018881:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552033792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480349.018980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480349.019953:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033792 00000100:00100000:3.0:1789480349.019966:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033792 00000100:00100000:3.0:1789480349.020059:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480349.020071:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552033792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480349.020125:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480349.020204:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552033792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.020211:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789480349.020334:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480349.020388:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552033792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480349.020753:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552033920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480349.020802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480349.020855:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552033920 00000100:00100000:1.0:1789480349.020860:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552033920 00000100:00100000:1.0:1789480349.020894:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480349.020901:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552033920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480349.020929:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480349.020968:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552033920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480349.020989:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789480349.021006:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480349.021032:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552033920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480349.021665:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552034304:0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.021710:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480349.021750:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480349.021756:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405552034176:0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.021779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480349.021811:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552034304 00000100:00100000:2.0:1789480349.021816:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552034304 00000100:00100000:2.0:1789480349.021860:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552034176 00000100:00100000:2.0:1789480349.021864:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552034176 00000100:00100000:2.0:1789480349.021895:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789480349.021904:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405552034304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.021958:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405552034304:12345-0@lo:400:kworker.0 Request processed in 56us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480349.021965:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789480349.021983:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480349.021988:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405552034176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.022015:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405552034176:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480349.022025:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480349.022062:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405552034176:0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.022071:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405552034304:0@lo:400:kworker.0 00000100:00100000:1.0:1789480349.023366:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552034048:0@lo:400:kworker.0 00000100:00100000:1.0:1789480349.023449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480349.023533:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480349.023551:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552034432:0@lo:400:kworker.0 00000100:00100000:1.0:1789480349.023583:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480349.023671:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552034048 00000100:00100000:2.0:1789480349.023680:0:18858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552034048 00000100:00100000:3.0:1789480349.023852:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552034432 00000100:00100000:3.0:1789480349.023858:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552034432 00000100:00100000:3.0:1789480349.023903:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480349.023912:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480349.023969:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552034432:12345-0@lo:400:kworker.0 Request processed in 58us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.023976:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789480349.024134:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480349.024175:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552034432:0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.026733:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789480349.026756:0:18858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552034048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480349.026907:0:18858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2016df8a-d509-4535-998f-23fecb5de199+19:3301:x1876405552034048:12345-0@lo:400:kworker.0 Request processed in 161us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480349.026916:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789480349.028505:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2016df8a-d509-4535-998f-23fecb5de199:3301:1876405552034048:0@lo:400:kworker.0 00000100:00100000:3.0:1789480349.147676:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.158243:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526871040 00000100:00100000:2.0:1789480349.158266:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526871040 00000100:00100000:0.0:1789480349.159245:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480349.159271:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:17382:x1876405526871040:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480349.159332:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480349.159360:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37eb expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.159506:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.159656:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.159690:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.159705:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.159712:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.159719:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162748:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229200/0xbb972366037ff07d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162773:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229200/0xbb972366037ff07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162786:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229200/0xbb972366037ff07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480349.162821:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789480349.162825:0:18867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480349.162866:0:18867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229200/0xbb972366037ff07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162879:0:18867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162886:0:18867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162908:0:18867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162915:0:18867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480349.162919:0:18867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162927:0:18867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162939:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:0.0:1789480349.162942:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480349.162947:0:18867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162966:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff06f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162980:0:18867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162986:0:18867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.162993:0:18867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165160:0:18867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480349.165168:0:18867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165198:0:18867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165217:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2290d74e00) 00010000:00010000:0.0:1789480349.165219:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480349.165223:0:18867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165229:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165313:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37eb expref: 8 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165327:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229200/0xbb972366037ff07d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37eb expref: 7 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.165334:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2290d74200) 00010000:00010000:0.0:1789480349.165336:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480349.165339:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229200, rc 0) 00000100:00100000:0.0:1789480349.165407:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:17382:x1876405526871040:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6148us (17744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480349.165416:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480349.193790:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.193920:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526871296 00000100:00100000:2.0:1789480349.193934:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526871296 00000100:00100000:2.0:1789480349.194013:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789480349.194026:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:17382:x1876405526871296:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480349.194064:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480349.194098:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff084 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37f2 expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.194198:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.194227:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.194243:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.194260:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.194266:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.194272:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195323:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffc00/0xbb972366037ff099 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195340:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffc00/0xbb972366037ff099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195350:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffc00/0xbb972366037ff099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480349.195363:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789480349.195637:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195646:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195654:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195661:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.195666:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195675:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195689:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2290d74200) 00010000:00010000:2.0:1789480349.195692:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.195698:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195716:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff08b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195731:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195737:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195743:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195748:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffec00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.195751:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195758:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195766:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2290ce3c00) 00010000:00010000:2.0:1789480349.195768:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.195771:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.195776:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff092 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.196430:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff084 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37f2 expref: 10 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.196462:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffc00/0xbb972366037ff099 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37f2 expref: 9 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.196470:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3a00) 00010000:00010000:2.0:1789480349.196473:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.196486:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffc00, rc 0) 00000100:00100000:2.0:1789480349.196580:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17382:x1876405526871296:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2555us (2804us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789480349.196590:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789480349.208523:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.208938:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526871424 00000100:00100000:3.0:1789480349.208953:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526871424 00000100:00100000:3.0:1789480349.209037:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789480349.209050:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17382:x1876405526871424:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789480349.209219:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17382:x1876405526871424:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 171us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.209227:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789480349.265812:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480349.266120:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526871552 00000100:00100000:1.0:1789480349.266136:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526871552 00000100:00100000:1.0:1789480349.266218:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1789480349.266231:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17388:x1876405526871552:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480349.266260:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480349.266692:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037ff0a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f37f9 expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.266786:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.266804:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.266844:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.266862:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.266870:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.266877:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267216:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267225:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267233:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267240:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480349.267245:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267253:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267269:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:1.0:1789480349.267272:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480349.267278:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267322:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff0ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267418:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267426:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267432:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267437:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ce00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480349.267441:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267448:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267456:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d228868fd00) 00010000:00010000:1.0:1789480349.267459:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480349.267462:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267469:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff0b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.267525:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037ff0a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37f9 expref: 10 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.268152:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:1.0:1789480349.268156:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480349.268162:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037ff0a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37f9 expref: 10 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.268174:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d000, rc 0) 00000100:00100000:1.0:1789480349.269613:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17388:x1876405526871552:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3374us (3806us total) trans 0 rc 301/301 00000100:00100000:1.0:1789480349.269625:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1789480349.281444:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.281921:0:18875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526871680 00000100:00100000:3.0:1789480349.281934:0:18875:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526871680 00000100:00100000:3.0:1789480349.282010:0:18875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480349.282023:0:18875:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17388:x1876405526871680:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:3.0:1789480349.282184:0:18875:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17388:x1876405526871680:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 163us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.282193:0:18875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480349.290352:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480349.290719:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526871936 00000100:00100000:0.0:1789480349.290733:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526871936 00000100:00100000:0.0:1789480349.290818:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789480349.290850:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17388:x1876405526871936:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1789480349.290929:0:18868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480349.290964:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fefea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3774 expref: 9 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.290989:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:0.0:1789480349.290995:0:18868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480349.291345:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.291364:0:18868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 5 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.291373:0:18868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.291415:0:18868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 5 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.291431:0:18868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 5 pid: 18868 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480349.291448:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18868:1876405552034560:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480349.291582:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480349.294728:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.295011:0:18853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526872064 00000100:00100000:3.0:1789480349.295023:0:18853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526872064 00010000:00010000:3.0:1789480349.295090:0:18853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 6 pid: 18868 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480349.295145:0:18853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789480349.295157:0:18853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2348:x1876405526872064:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480349.295175:0:18853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480349.295183:0:18853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 6 pid: 18868 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.295223:0:18853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 6 pid: 18868 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.295252:0:18853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480349.295258:0:18853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.295270:0:18853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.295279:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.295364:0:18853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480349.295431:0:18853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2348:x1876405526872064:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 276us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.295440:0:18853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00010000:00010000:0.0:1789480349.295890:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f37d6 expref: 5 pid: 18868 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480349.295918:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18868:1876405552034560:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480349.295959:0:18868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.295969:0:18868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.295976:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.296002:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.296014:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.296024:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480349.303389:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789480349.303411:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.303422:0:18868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.303430:0:18868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.304828:0:18868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480349.304835:0:18868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.304846:0:18868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.304883:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:0.0:1789480349.304886:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480349.304892:0:18868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.304899:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff0bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480349.304925:0:18868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b457c660 reply state 000000009800b566 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480349.304934:0:18868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480349.305058:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+10:17388:x1876405526871936:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 14208us (14780us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789480349.305067:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:3.0:1789480349.320926:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.320951:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.320962:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.320968:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480349.320974:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.321006:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.321029:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2290d74e00) 00010000:00010000:3.0:1789480349.321033:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480349.321040:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.321046:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff0c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480349.408143:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789480349.456065:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.462301:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526872192 00000100:00100000:3.0:1789480349.462326:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526872192 00000100:00100000:3.0:1789480349.462463:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480349.462491:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:17396:x1876405526872192:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:3.0:1789480349.462527:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480349.462638:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff0ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3800 expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.462727:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037ff0d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.462744:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037ff0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.462758:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037ff0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480349.462802:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480349.462821:0:18866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480349.462864:0:18866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037ff0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.462889:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff0ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3800 expref: 11 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.462906:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037ff0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3800 expref: 10 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.462925:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480349.462928:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480349.462932:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4000, rc 0) 00000100:00100000:3.0:1789480349.463026:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+10:17396:x1876405526872192:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 538us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.463034:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1789480349.517427:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.517722:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526872320 00000100:00100000:3.0:1789480349.517736:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526872320 00000100:00100000:3.0:1789480349.517816:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1789480349.517829:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:17397:x1876405526872320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480349.517858:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480349.517890:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3807 expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.517998:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff0df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.518016:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.518327:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480349.518379:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480349.518384:0:18867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480349.518414:0:18867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.518448:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3807 expref: 7 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.518602:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037ff0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3807 expref: 6 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.518613:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480349.518617:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480349.518622:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5000, rc 0) 00000100:00100000:3.0:1789480349.518711:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:17397:x1876405526872320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 884us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480349.518719:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1789480349.522408:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.522504:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526872448 00000100:00100000:2.0:1789480349.522517:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526872448 00000100:00100000:2.0:1789480349.522612:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480349.522626:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:17397:x1876405526872448:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480349.522656:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480349.522682:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff0e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f380e expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522765:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522783:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522798:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522844:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522852:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522860:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522978:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff0fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522987:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff0fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.522995:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff0fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480349.523034:0:20746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480349.523038:0:20746:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480349.523063:0:20746:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff0fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523077:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523084:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523091:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523110:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.523115:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523124:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523140:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:2.0:1789480349.523144:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.523150:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523157:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff0ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523172:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523178:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523184:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523190:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.523192:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523199:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523218:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2290ce3c00) 00010000:00010000:2.0:1789480349.523220:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.523224:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523230:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff0f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523267:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff0e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f380e expref: 8 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523331:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff0fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f380e expref: 7 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.523340:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:2.0:1789480349.523343:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480349.523345:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:2.0:1789480349.524905:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d3d6d55-1b4d-481a-820a-bd754766c9b2+7:17397:x1876405526872448:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2269us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480349.524921:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480349.533014:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.533161:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526872704 00000100:00100000:3.0:1789480349.533175:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526872704 00000100:00100000:3.0:1789480349.533249:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789480349.533261:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+7:17397:x1876405526872704:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480349.533321:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480349.533349:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff102 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3815 expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480349.537423:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480349.537625:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff102 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3815 expref: 9 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.537646:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:2.0:1789480349.537650:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480349.537673:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037ff102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3815 expref: 9 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.537692:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4400, rc 0) 00000100:00100000:2.0:1789480349.537788:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+8:17397:x1876405526872704:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4527us (4788us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1789480349.537798:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789480349.553735:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480349.554174:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526872960 00000100:00100000:3.0:1789480349.554188:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526872960 00000100:00100000:3.0:1789480349.554272:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789480349.554342:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+8:17397:x1876405526872960:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:3.0:1789480349.554423:0:18866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480349.554460:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff0fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f380e expref: 8 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.556038:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:3.0:1789480349.556056:0:18866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480349.557159:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.557183:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.557198:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480349.559390:0:18866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009405c0a reply state 0000000059fa74c2 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480349.559414:0:18866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789480349.559425:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789480349.561790:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+9:17397:x1876405526872960:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 7490us (8052us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789480349.561827:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:2.0:1789480349.573380:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.573403:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.573412:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.573420:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.573426:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.573435:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.573458:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2290d74100) 00010000:00010000:2.0:1789480349.573461:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789480349.573481:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.573488:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff110 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480349.577927:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.578021:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526873216 00000100:00100000:2.0:1789480349.578060:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526873216 00000100:00100000:2.0:1789480349.578147:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1789480349.578160:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+8:17397:x1876405526873216:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480349.578543:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+9:17397:x1876405526873216:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 385us (642us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789480349.578552:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789480349.592542:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480349.592808:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526873472 00000100:00100000:0.0:1789480349.592823:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526873472 00000100:00100000:0.0:1789480349.592901:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1789480349.592913:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+9:17397:x1876405526873472:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480349.592944:0:18868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480349.592973:0:18868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f381c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593425:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593444:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593460:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593496:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593503:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593509:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480349.593802:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789480349.593924:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593957:0:18868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593964:0:18868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593971:0:18868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480349.593977:0:18868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.593987:0:18868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.594002:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:0.0:1789480349.594006:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480349.594012:0:18868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.594020:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff11e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.594039:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.594059:0:18868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.594067:0:18868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595331:0:18868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480349.595361:0:18868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595376:0:18868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595393:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2290d74500) 00010000:00010000:0.0:1789480349.595396:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480349.595400:0:18868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595407:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff125 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595927:0:18868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff117 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f381c expref: 11 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595940:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:0.0:1789480349.595942:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480349.595946:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f381c expref: 11 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.595958:0:18868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229400, rc 0) 00000100:00100000:0.0:1789480349.597304:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d3d6d55-1b4d-481a-820a-bd754766c9b2+10:17397:x1876405526873472:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4368us (4762us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789480349.597319:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1789480349.614104:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480349.614213:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526873600 00000100:00100000:1.0:1789480349.614226:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526873600 00000100:00100000:1.0:1789480349.614348:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1789480349.614362:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d3d6d55-1b4d-481a-820a-bd754766c9b2+10:17397:x1876405526873600:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480349.614397:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480349.614430:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff133 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3823 expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.614579:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.614616:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.614632:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480349.614671:0:20746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789480349.614675:0:20746:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480349.614700:0:20746:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.614736:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff133 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 12 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.614757:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 11 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.614767:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:1.0:1789480349.614771:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480349.614776:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d600, rc 0) 00000100:00100000:1.0:1789480349.614849:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d3d6d55-1b4d-481a-820a-bd754766c9b2+11:17397:x1876405526873600:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 491us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480349.614856:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1789480349.622481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.622666:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526873728 00000100:00100000:2.0:1789480349.622680:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526873728 00000100:00100000:2.0:1789480349.622747:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1789480349.622758:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+11:17397:x1876405526873728:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:2.0:1789480349.648320:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+11:17397:x1876405526873728:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 25298us (25604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480349.648340:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1789480349.667644:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480349.667887:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526873984 00000100:00100000:0.0:1789480349.667902:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526873984 00000100:00100000:0.0:1789480349.667981:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789480349.667994:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c0c9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+11:17397:x1876405526873984:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480349.668389:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c0c9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+12:17397:x1876405526873984:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 387us (751us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789480349.668398:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789480349.754261:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.754721:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526874112 00000100:00100000:2.0:1789480349.754735:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526874112 00000100:00100000:2.0:1789480349.754810:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1789480349.754823:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+10:17403:x1876405526874112:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480349.754854:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480349.754884:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f382a expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.754970:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.754987:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755019:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755037:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755044:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755051:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755188:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037ff156 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755197:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037ff156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755204:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037ff156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480349.755238:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480349.755243:0:18867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480349.755616:0:18867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037ff156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755634:0:18867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755642:0:18867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755663:0:18867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755670:0:18867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.755674:0:18867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755684:0:18867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755698:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:2.0:1789480349.755701:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.755707:0:18867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755713:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff200/0xbb972366037ff148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755729:0:18867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755735:0:18867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755741:0:18867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755746:0:18867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480349.755749:0:18867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755765:0:18867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755774:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2290ce3c00) 00010000:00010000:2.0:1789480349.755776:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480349.755779:0:18867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755785:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff14f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755826:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f382a expref: 12 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755843:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037ff156 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f382a expref: 11 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.755850:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:2.0:1789480349.755853:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789480349.755855:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffe00, rc 0) 00000100:00100000:2.0:1789480349.756100:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+11:17403:x1876405526874112:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1279us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480349.756108:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1789480349.772921:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480349.773812:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526874368 00000100:00100000:2.0:1789480349.773837:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526874368 00000100:00100000:2.0:1789480349.773925:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1789480349.773939:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+11:17403:x1876405526874368:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480349.773991:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480349.774019:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff15d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3831 expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.774184:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.774223:0:20746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 11 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.774234:0:20746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.774301:0:20746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 11 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480349.774321:0:20746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 11 pid: 20746 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480349.774337:0:20746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdcc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20746:1876405552034688:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480349.775080:0:20746:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480349.789649:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480349.790124:0:20746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdcc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20746:1876405552034688:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480349.790169:0:20746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480349.794126:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526874496 00000100:00100000:0.0:1789480349.794151:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526874496 00010000:00010000:0.0:1789480349.794236:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 12 pid: 20746 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480349.794312:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789480349.794669:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+12:2347:x1876405526874496:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480349.794692:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480349.794701:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 12 pid: 20746 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.794721:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 12 pid: 20746 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.794751:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff13a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3823 expref: 12 pid: 20746 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.794776:0:18851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:0.0:1789480349.794782:0:18851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.794793:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.794803:0:18851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.794855:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480349.794996:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d3d6d55-1b4d-481a-820a-bd754766c9b2+11:2347:x1876405526874496:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 672us (5363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480349.795005:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:1.0:1789480349.796194:0:20746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.796222:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.802161:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.802201:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.802214:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803341:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803358:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803368:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480349.803382:0:20746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789480349.803410:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803417:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803424:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803438:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480349.803442:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.803450:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.807207:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:1.0:1789480349.807219:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480349.807229:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.807240:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff164 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480349.807266:0:20746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024a1714f reply state 00000000085eb13d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480349.807276:0:20746:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789480349.807352:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037ff15d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 14 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.807389:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 13 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480349.807397:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:1.0:1789480349.807399:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789480349.807402:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c000, rc 0) 00000100:00100000:1.0:1789480349.807485:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+14:17403:x1876405526874368:12345-192.168.204.54@tcp:101:bash.0 Request processed in 33548us (34580us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789480349.807510:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:3.0:1789480349.817551:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.817574:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.817584:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.817592:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480349.817598:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.817607:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.817628:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d228868f300) 00010000:00010000:3.0:1789480349.817632:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480349.817658:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480349.817665:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff16b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480349.835181:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480349.835616:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526874624 00000100:00100000:0.0:1789480349.835631:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526874624 00000100:00100000:0.0:1789480349.835715:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1789480349.835727:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+13:17403:x1876405526874624:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480349.835760:0:18868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480349.835789:0:18868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff180 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3838 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.835885:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.835902:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.835914:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480349.835967:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480349.835972:0:18868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480349.836000:0:18868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.836012:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.836040:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff180 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3838 expref: 15 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.836092:0:18868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3838 expref: 14 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480349.836102:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480349.836106:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480349.836111:0:18868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228e00, rc 0) 00000100:00100000:0.0:1789480349.838552:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+14:17403:x1876405526874624:12345-192.168.204.54@tcp:101:bash.0 Request processed in 475us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480349.838569:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789480349.846905:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480349.847026:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526874880 00000100:00100000:0.0:1789480349.847040:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526874880 00000100:00100000:0.0:1789480349.847124:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789480349.847137:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+14:17403:x1876405526874880:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1789480349.847689:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:17403:x1876405526874880:12345-192.168.204.54@tcp:35:bash.0 Request processed in 553us (799us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789480349.847698:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00010000:00010000:1.0:1789480349.982072:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480350.003960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.006639:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526875136 00000100:00100000:0.0:1789480350.006661:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526875136 00000100:00100000:0.0:1789480350.006784:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1789480350.006803:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:17413:x1876405526875136:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480350.006849:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480350.006879:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff18e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f383f expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480350.007012:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789480350.007190:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff18e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f383f expref: 17 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.007209:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:0.0:1789480350.007212:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480350.007218:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff18e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f383f expref: 17 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.007234:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229400, rc 0) 00000100:00100000:0.0:1789480350.007383:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+16:17413:x1876405526875136:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 587us (3437us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1789480350.007392:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00080000:1.0:1789480350.007649:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480350.021163:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.021268:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526875392 00000100:00100000:0.0:1789480350.021312:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526875392 00000100:00100000:0.0:1789480350.021370:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480350.021378:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+16:17413:x1876405526875392:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480350.021689:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17413:x1876405526875392:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 310us (536us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789480350.021696:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789480350.053520:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480350.053559:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526875648 00000100:00100000:2.0:1789480350.053569:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526875648 00000100:00100000:2.0:1789480350.053623:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1789480350.053635:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17416:x1876405526875648:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480350.053680:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480350.053706:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe200/0xbb972366037ff19c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3846 expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.054804:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff1a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.054832:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff1a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.054850:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff1a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480350.054875:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789480350.055150:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe200/0xbb972366037ff19c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3846 expref: 20 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.055180:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff1a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3846 expref: 19 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.055190:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:1.0:1789480350.055194:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480350.055199:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39ce00, rc 0) 00000100:00100000:1.0:1789480350.055345:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:17416:x1876405526875648:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1710us (1833us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1789480350.055360:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1789480350.064160:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480350.064544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480350.065005:0:18852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526875904 00000100:00100000:3.0:1789480350.065015:0:18852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526875904 00000100:00100000:3.0:1789480350.065087:0:18852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480350.065097:0:18852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:2346:x1876405526875904:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480350.065112:0:18852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480350.065138:0:18852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff1a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3846 expref: 19 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.065156:0:18852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480350.065161:0:18852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480350.065216:0:18852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:2346:x1876405526875904:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 121us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480350.065224:0:18852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789480350.065597:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526875776 00000100:00100000:0.0:1789480350.065603:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526875776 00000100:00100000:0.0:1789480350.065641:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1789480350.065659:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:17416:x1876405526875776:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1789480350.065892:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.065911:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.065936:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.065975:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.065983:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.065990:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.065996:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480350.066001:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.066009:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.066019:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480350.066021:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480350.066026:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.066032:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480350.066902:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:17416:x1876405526875776:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 1248us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480350.066912:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1789480350.083796:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.083895:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526876160 00000100:00100000:0.0:1789480350.083906:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526876160 00000100:00100000:0.0:1789480350.084044:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480350.084056:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:17416:x1876405526876160:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480350.084850:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:17416:x1876405526876160:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 228us (492us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1789480350.084863:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000001:00080000:0.0:1789480350.145581:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901899 is committed 00000001:00080000:0.0:1789480350.145605:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1789480350.455965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480350.456277:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526876416 00000100:00100000:1.0:1789480350.456320:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526876416 00000100:00100000:1.0:1789480350.456387:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789480350.456397:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+13:17447:x1876405526876416:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1789480350.456424:0:18868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480350.456445:0:18868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff1b8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f384d expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.456556:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff1bf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.456572:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff1bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.456584:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff1bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480350.456597:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789480350.456757:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037ff1b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f384d expref: 16 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.456776:0:18868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff1bf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f384d expref: 15 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480350.456786:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:1.0:1789480350.456789:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480350.456792:0:18868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d600, rc 0) 00000100:00100000:1.0:1789480350.456862:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:17447:x1876405526876416:12345-192.168.204.54@tcp:101:cat.0 Request processed in 466us (908us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1789480350.456885:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789480350.463851:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.464048:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526876672 00000100:00100000:0.0:1789480350.464059:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526876672 00000100:00100000:0.0:1789480350.464121:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480350.464132:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:17447:x1876405526876672:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1789480350.464552:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.464588:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+16:17447:x1876405526876672:12345-192.168.204.54@tcp:35:cat.0 Request processed in 455us (743us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789480350.464597:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789480350.464759:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526876800 00000100:00100000:3.0:1789480350.464764:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526876800 00000100:00100000:3.0:1789480350.464885:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1789480350.464894:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+16:2345:x1876405526876800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480350.464905:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480350.464927:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff1bf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f384d expref: 16 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.464967:0:18851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480350.464972:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480350.465002:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:2345:x1876405526876800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480350.465009:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1789480350.568341:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480350.568472:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526877056 00000100:00100000:3.0:1789480350.568488:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526877056 00000100:00100000:3.0:1789480350.568657:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1789480350.568672:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:17453:x1876405526877056:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:3.0:1789480350.568728:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480350.568758:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff1cd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3854 expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.568908:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff1d4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.568927:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff1d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.568941:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff1d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480350.568968:0:20746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789480350.570426:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff1cd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3854 expref: 18 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.570470:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff1d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3854 expref: 17 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.570501:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480350.570504:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480350.570675:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480350.570870:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17453:x1876405526877056:12345-192.168.204.54@tcp:101:dd.0 Request processed in 2200us (2593us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1789480350.570880:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1789480350.575055:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480350.575168:0:18853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526877184 00000100:00100000:3.0:1789480350.575183:0:18853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526877184 00000100:00100000:3.0:1789480350.575277:0:18853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1789480350.575323:0:18853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:2345:x1876405526877184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480350.575343:0:18853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480350.575380:0:18853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff1d4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3854 expref: 17 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.575405:0:18853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480350.575412:0:18853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480350.575497:0:18853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+16:2345:x1876405526877184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 178us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480350.575505:0:18853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789480350.583848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.583980:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526877440 00000100:00100000:0.0:1789480350.583994:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526877440 00000100:00100000:0.0:1789480350.584084:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1789480350.584098:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+16:17453:x1876405526877440:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:0.0:1789480350.584184:0:18868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480350.584223:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff187 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3838 expref: 16 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.584249:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480350.584256:0:18868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480350.584628:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.584646:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480350.584659:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480350.584713:0:18868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1789480350.584742:0:18868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016815fb7 reply state 000000001349273e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480350.584753:0:18868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480350.584879:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:17453:x1876405526877440:12345-192.168.204.54@tcp:36:dd.0 Request processed in 784us (1047us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1789480350.584888:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000020:00080000:0.0:1789480350.584894:0:18868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480350.588364:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.588388:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.588399:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.588427:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480350.588434:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.588443:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.588478:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480350.588481:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480350.588487:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480350.588493:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff1e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480350.736146:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480350.736555:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526877696 00000100:00100000:0.0:1789480350.736569:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526877696 00000100:00100000:0.0:1789480350.736662:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789480350.736674:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17453:x1876405526877696:12345-192.168.204.54@tcp:35:dd.0 00000100:00100000:0.0:1789480350.737216:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:17453:x1876405526877696:12345-192.168.204.54@tcp:35:dd.0 Request processed in 542us (1083us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1789480350.737226:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00010000:00010000:1.0:1789480351.003035:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480351.088923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480351.089655:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526877824 00000100:00100000:0.0:1789480351.089669:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526877824 00000100:00100000:0.0:1789480351.089842:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1789480351.089856:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+18:17467:x1876405526877824:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1789480351.089893:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480351.089939:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff1e9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f385b expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.090105:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.090122:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.090137:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.090151:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.090158:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.090164:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.091588:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.091680:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.091692:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480351.091893:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480351.091898:0:18866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480351.091954:0:18866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.091978:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.091989:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.091997:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092003:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092010:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480351.092014:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092098:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092112:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:0.0:1789480351.092115:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480351.092120:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092127:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff1f0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092143:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092149:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092161:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092167:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480351.092170:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092176:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092183:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d2290d74700) 00010000:00010000:0.0:1789480351.092185:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480351.092188:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092193:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff1f7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092922:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff1e9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f385b expref: 20 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092947:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f385b expref: 19 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.092955:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480351.092957:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480351.092960:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228600, rc 0) 00000100:00100000:0.0:1789480351.093114:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:17467:x1876405526877824:12345-192.168.204.54@tcp:101:stat.0 Request processed in 3260us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480351.093139:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1789480351.245995:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480351.250530:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526878080 00000100:00100000:0.0:1789480351.250547:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526878080 00000100:00100000:0.0:1789480351.251385:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1789480351.251399:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:17473:x1876405526878080:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:0.0:1789480351.251464:0:18868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480351.251490:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff1fe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f385b expref: 19 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.251511:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480351.251516:0:18868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480351.252502:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.252520:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.252531:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480351.252585:0:18868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1789480351.252611:0:18868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073301df2 reply state 0000000090d89226 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480351.253153:0:18868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480351.253317:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+21:17473:x1876405526878080:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1919us (7328us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789480351.253326:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000020:00080000:0.0:1789480351.253348:0:18868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480351.258657:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.258678:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.258686:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.258692:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480351.258698:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.258708:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.258760:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480351.258763:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480351.258770:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.258777:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff205 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480351.451426:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789480351.559859:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480351.560177:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526878208 00000100:00100000:2.0:1789480351.560188:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526878208 00000100:00100000:2.0:1789480351.560335:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1789480351.560346:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+20:17487:x1876405526878208:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1789480351.560381:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480351.560401:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff20c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3862 expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.560492:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.560508:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.560520:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.560550:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.560558:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.560566:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561062:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561074:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561082:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480351.561118:0:20746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789480351.561122:0:20746:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480351.561143:0:20746:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561156:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561164:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561171:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561188:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561194:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480351.561197:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561205:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561216:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:2.0:1789480351.561219:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480351.561224:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561231:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037ff213 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561242:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561249:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561255:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561260:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480351.561263:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561279:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561322:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d2290ce3c00) 00010000:00010000:2.0:1789480351.561325:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480351.561328:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561335:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037ff21a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561366:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff20c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 22 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561380:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 21 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.561388:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:2.0:1789480351.561391:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480351.561393:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff800, rc 0) 00000100:00100000:2.0:1789480351.561896:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+21:17487:x1876405526878208:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1550us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480351.561906:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1789480351.720042:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480351.720490:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526878464 00000100:00100000:2.0:1789480351.720501:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526878464 00000100:00100000:2.0:1789480351.720571:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789480351.720581:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+21:17497:x1876405526878464:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480351.720626:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480351.720648:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3869 expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480351.720757:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480351.720886:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff228 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3869 expref: 23 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.720900:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:2.0:1789480351.720903:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480351.720908:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3869 expref: 23 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.720922:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff000, rc 0) 00000100:00100000:2.0:1789480351.720998:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+22:17497:x1876405526878464:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 418us (965us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1789480351.721005:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1789480351.726718:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480351.730117:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526878720 00000100:00100000:2.0:1789480351.730134:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526878720 00000100:00100000:2.0:1789480351.730200:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789480351.730212:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c0c9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+22:17497:x1876405526878720:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480351.730527:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c0c9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17497:x1876405526878720:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 317us (3822us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1789480351.730534:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789480351.877539:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480351.881539:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526878976 00000100:00100000:0.0:1789480351.881556:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526878976 00000100:00100000:0.0:1789480351.881654:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1789480351.881664:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17503:x1876405526878976:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480351.881690:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480351.881715:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff236 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3870 expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.881828:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.881843:0:18866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 24 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.881851:0:18866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 24 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.881858:0:18866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.881892:0:18866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 24 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.881906:0:18866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 24 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480351.881920:0:18866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552034816:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480351.882037:0:18866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 24 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.882059:0:18866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 24 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480351.882068:0:18866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552034944:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480351.882091:0:18866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290dfa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789480351.885050:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480351.885082:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480351.885252:0:18852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526879104 00000100:00100000:3.0:1789480351.885261:0:18852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526879104 00010000:00010000:3.0:1789480351.885336:0:18852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 25 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480351.885365:0:18852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526879232 00000100:00100000:3.0:1789480351.885367:0:18852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526879232 00010000:00010000:3.0:1789480351.885378:0:18852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 26 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480351.885391:0:18852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480351.885399:0:18852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:2345:x1876405526879104:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480351.885412:0:18852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480351.885419:0:18852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 26 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885446:0:18852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 26 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885488:0:18852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480351.885493:0:18852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885501:0:18852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885508:0:18852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480351.885558:0:18852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:2345:x1876405526879104:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 159us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480351.885566:0:18852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480351.885585:0:18852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1789480351.885592:0:18852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:2345:x1876405526879232:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480351.885600:0:18852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480351.885790:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff221 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3862 expref: 25 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480351.885809:0:18866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552034816:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480351.885820:0:18866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552034944:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480351.885849:0:18866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885891:0:18852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 24 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885902:0:18852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 24 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885913:0:18852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff172 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3831 expref: 24 pid: 20746 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885924:0:18852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480351.885928:0:18852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885990:0:18852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.885997:0:18852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.886066:0:18852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480351.886101:0:18852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:2345:x1876405526879232:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 509us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480351.886108:0:18852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:0.0:1789480351.899402:0:18866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.899419:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480351.899453:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1789480351.899703:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff236 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 24 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.899727:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 23 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.899757:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480351.899760:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789480351.899763:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229000, rc 0) 00000100:00100000:0.0:1789480351.899910:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17503:x1876405526878976:12345-192.168.204.54@tcp:101:bash.0 Request processed in 18246us (22383us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1789480351.899919:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1789480351.912142:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480351.916436:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526879488 00000100:00100000:1.0:1789480351.916451:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526879488 00000100:00100000:1.0:1789480351.916532:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1789480351.916543:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17503:x1876405526879488:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1789480351.916852:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480351.916870:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480351.916883:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480351.916936:0:18867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1789480351.916964:0:18867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acb7602f reply state 000000008923accc transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480351.916973:0:18867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480351.917080:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17503:x1876405526879488:12345-192.168.204.54@tcp:36:bash.0 Request processed in 537us (4946us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1789480351.917088:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000020:00080000:1.0:1789480351.917108:0:18867:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480351.920845:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.920869:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.920877:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.920883:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480351.920888:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.920901:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.920921:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480351.920924:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480351.920928:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.920954:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037ff24b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480351.922113:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480351.922394:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526879616 00000100:00100000:3.0:1789480351.922404:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526879616 00000100:00100000:3.0:1789480351.922460:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1789480351.922470:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17503:x1876405526879616:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480351.922494:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480351.922514:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff252 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3877 expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.922572:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff252 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3877 expref: 26 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.922587:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff252 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3877 expref: 26 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.922618:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480351.922621:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480351.922625:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480351.922689:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17503:x1876405526879616:12345-192.168.204.54@tcp:101:bash.0 Request processed in 220us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480351.922696:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789480351.959522:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480351.959649:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526879744 00000100:00100000:2.0:1789480351.959659:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526879744 00000100:00100000:2.0:1789480351.959723:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1789480351.959733:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17503:x1876405526879744:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480351.959753:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480351.959775:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff259 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f387e expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.959854:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.961015:0:18867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 27 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.961029:0:18867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.961077:0:18867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 27 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.961093:0:18867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 27 pid: 18866 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480351.961109:0:18867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18867:1876405552035072:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480351.961203:0:18867:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480351.966497:0:18867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18867:1876405552035072:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480351.966533:0:18867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480351.971965:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480351.972210:0:18853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526879872 00000100:00100000:2.0:1789480351.972220:0:18853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526879872 00010000:00010000:2.0:1789480351.972307:0:18853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 28 pid: 18866 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480351.972369:0:18853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1789480351.972379:0:18853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+28:2347:x1876405526879872:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480351.972395:0:18853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480351.972402:0:18853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 28 pid: 18866 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.972417:0:18853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 28 pid: 18866 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.972451:0:18853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff23d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3870 expref: 28 pid: 18866 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.972467:0:18853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:2.0:1789480351.972472:0:18853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.972482:0:18853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.972489:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480351.972517:0:18853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480351.972571:0:18853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+27:2347:x1876405526879872:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 194us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480351.972579:0:18853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:3.0:1789480351.973206:0:18867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480351.973218:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480351.973275:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789480351.973368:0:18867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480351.988821:0:18867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.988892:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037ff259 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f387e expref: 27 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.988927:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f387e expref: 26 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480351.988936:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480351.988939:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480351.988942:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffea00, rc 0) 00000100:00100000:0.0:1789480351.989408:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17503:x1876405526879744:12345-192.168.204.54@tcp:101:bash.0 Request processed in 29673us (29891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480351.989428:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789480352.003772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.003906:0:18852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526880128 00000100:00100000:3.0:1789480352.003926:0:18852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526880128 00000100:00100000:3.0:1789480352.004008:0:18852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789480352.004020:0:18852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17503:x1876405526880128:12345-192.168.204.54@tcp:103:bash.0 00010000:00010000:3.0:1789480352.004037:0:18852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789480352.004064:0:18852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffea00/0xbb972366037ff260 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f387e expref: 26 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.004085:0:18852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff252 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3877 expref: 25 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.004095:0:18852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:3.0:1789480352.004105:0:18852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480352.004163:0:18852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+24:17503:x1876405526880128:12345-192.168.204.54@tcp:103:bash.0 Request processed in 145us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.004171:0:18852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00080000:1.0:1789480352.004231:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480352.007993:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.008115:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526880256 00000100:00100000:3.0:1789480352.008126:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526880256 00000100:00100000:3.0:1789480352.008185:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1789480352.008194:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+24:17503:x1876405526880256:12345-192.168.204.54@tcp:58:bash.0 00010000:00010000:3.0:1789480352.008318:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.008333:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.008354:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480352.009145:0:20746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480352.009340:0:20746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1789480352.009430:0:20746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1789480352.009550:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+24:17503:x1876405526880256:12345-192.168.204.54@tcp:58:bash.0 Request processed in 1355us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.009559:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789480352.013431:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.013529:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526880384 00000100:00100000:1.0:1789480352.013539:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526880384 00000100:00100000:1.0:1789480352.013611:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1789480352.013622:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+24:17503:x1876405526880384:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789480352.013641:0:18868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480352.013661:0:18868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3885 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.013714:0:18868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.013726:0:18868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 25 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.013745:0:18868:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.013775:0:18868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 25 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.013810:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:1.0:1789480352.013813:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480352.013818:0:18868:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 25 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.013826:0:18868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39ce00, rc 0) 00000100:00100000:1.0:1789480352.013894:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17503:x1876405526880384:12345-192.168.204.54@tcp:101:bash.0 Request processed in 274us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480352.013901:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:3.0:1789480352.028684:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480352.475363:0:18900:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789480352.475379:0:18900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480352.475438:0:18900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789480352.475447:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789480352.476112:0:18900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18900:1876405552035200:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480352.476267:0:18900:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a1721780 going to sleep for 11 seconds 00000100:00100000:0.0:1789480352.483205:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.483396:0:18877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526880512 00000100:00100000:3.0:1789480352.483422:0:18877:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526880512 00000100:00100000:3.0:1789480352.483507:0:18877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480352.483520:0:18877:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17504:x1876405526880512:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789480352.483637:0:18877:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17504:x1876405526880512:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 120us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.483645:0:18877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1789480352.484203:0:18900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18900:1876405552035200:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480352.494825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.494952:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526880640 00000100:00100000:3.0:1789480352.494967:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526880640 00000100:00100000:3.0:1789480352.495057:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1789480352.495070:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17504:x1876405526880640:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480352.495115:0:20746:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480352.495277:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17504:x1876405526880640:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 209us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.495320:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1789480352.499107:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.504533:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526880768 00000100:00100000:0.0:1789480352.504556:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526880768 00000100:00100000:0.0:1789480352.504678:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1789480352.504711:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17504:x1876405526880768:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.504840:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.504987:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505005:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505026:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505035:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505043:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505073:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505082:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505088:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480352.505135:0:18868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480352.505140:0:18868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480352.505154:0:18868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505176:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505182:0:18868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505190:0:18868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505197:0:18868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480352.505202:0:18868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505210:0:18868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505222:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3a00) 00010000:00010000:0.0:1789480352.505225:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480352.505230:0:18868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505235:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff275 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505249:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505255:0:18868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505260:0:18868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505269:0:18868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480352.505272:0:18868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505277:0:18868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505307:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8d2290d74700) 00010000:00010000:0.0:1789480352.505310:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480352.505313:0:18868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505319:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff27c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.505337:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.506496:0:18868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.506521:0:18868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.506527:0:18868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480352.506532:0:18868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.506542:0:18868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.506579:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:0.0:1789480352.506581:0:18868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480352.506587:0:18868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.506595:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff283 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.507303:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17504:x1876405526880768:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 2569us (8183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480352.507317:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1789480352.517841:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.517941:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526881024 00000100:00100000:3.0:1789480352.517972:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526881024 00000100:00100000:3.0:1789480352.518057:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1789480352.518070:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+25:17504:x1876405526881024:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480352.518099:0:20746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480352.518126:0:20746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff28a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f388c expref: -99 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518254:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518272:0:20746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518317:0:20746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480352.518332:0:20746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789480352.518587:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518596:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518604:0:20746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518610:0:20746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480352.518615:0:20746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518624:0:20746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518648:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:3.0:1789480352.518651:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480352.518659:0:20746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518665:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff291 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518725:0:20746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff28a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f388c expref: 27 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518737:0:20746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3a00) 00010000:00010000:3.0:1789480352.518739:0:20746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480352.518743:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff28a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f388c expref: 27 pid: 20746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.518753:0:20746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480352.518835:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17504:x1876405526881024:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 767us (1007us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1789480352.518843:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1789480352.526273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.526718:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526881152 00000100:00100000:0.0:1789480352.526733:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526881152 00000100:00100000:0.0:1789480352.526813:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789480352.526826:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17504:x1876405526881152:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789480352.526892:0:18867:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789480352.527045:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17504:x1876405526881152:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 221us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480352.527054:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1789480352.534451:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.535421:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526881408 00000100:00100000:0.0:1789480352.535440:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526881408 00000100:00100000:0.0:1789480352.535537:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:0.0:1789480352.535550:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+26:17504:x1876405526881408:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.535582:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480352.535614:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff29f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3893 expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789480352.536709:0:18866:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =60 00000004:00080000:0.0:1789480352.536720:0:18866:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+60 in llog 00000004:00080000:0.0:1789480352.536774:0:18866:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:0.0:1789480352.537155:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.537176:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.537191:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.537279:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff29f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3893 expref: 29 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.537342:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3893 expref: 28 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.537351:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74700) 00010000:00010000:0.0:1789480352.537354:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480352.537359:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229c00, rc 0) 00000100:00100000:0.0:1789480352.537464:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+28:17504:x1876405526881408:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1915us (3030us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1789480352.537475:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789480352.552455:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.552637:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526881664 00000100:00100000:0.0:1789480352.552650:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526881664 00000100:00100000:0.0:1789480352.552733:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1789480352.552746:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+28:17504:x1876405526881664:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.552850:0:18867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480352.552889:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2a6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3893 expref: 28 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.552916:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74700) 00010000:00010000:0.0:1789480352.552930:0:18867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480352.552965:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.552982:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.552994:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553010:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553018:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553025:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553379:0:18867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553389:0:18867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553397:0:18867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553425:0:18867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480352.553431:0:18867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553440:0:18867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553450:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:0.0:1789480352.553453:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480352.553457:0:18867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553463:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff2b4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553484:0:18867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553491:0:18867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553496:0:18867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553501:0:18867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480352.553503:0:18867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553510:0:18867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553528:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa229f29f (ffff8d2290d74500) 00010000:00010000:0.0:1789480352.553531:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480352.553534:0:18867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.553541:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229e00/0xbb972366037ff2bb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa229f29f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.553654:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+27:17504:x1876405526881664:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 909us (1215us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480352.553663:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1789480352.559053:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.559898:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526881792 00000100:00100000:0.0:1789480352.559914:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526881792 00000100:00100000:0.0:1789480352.560013:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1789480352.560028:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+27:17504:x1876405526881792:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.560060:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480352.560091:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2c2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f389a expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.560139:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff2c9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.560157:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff2c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.560171:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff2c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.560348:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2c2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f389a expref: 29 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.560383:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228e00/0xbb972366037ff2c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f389a expref: 28 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.560393:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:0.0:1789480352.560397:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480352.560402:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228e00, rc 0) 00000100:00100000:0.0:1789480352.560514:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+28:17504:x1876405526881792:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 488us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480352.560522:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1789480352.569480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.570128:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526882048 00000100:00100000:0.0:1789480352.570144:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526882048 00000100:00100000:0.0:1789480352.570219:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789480352.570231:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+28:17504:x1876405526882048:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.570430:0:18867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.570454:0:18867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.570479:0:18867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480352.572471:0:18867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1789480352.572512:0:18867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 645569228792ns, next at 646569222520ns, rc = 0 00000004:00010000:1.0:1789480352.572695:0:18867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084eaf796 reply state 00000000b39bc131 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480352.572721:0:18867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480352.573093:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+30:17504:x1876405526882048:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2858us (3630us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1789480352.573104:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:3.0:1789480352.590024:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.590049:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.590058:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.590091:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480352.590097:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.590106:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.590132:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:3.0:1789480352.590135:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480352.590142:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.590148:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff2d0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480352.593859:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.593987:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526882176 00000100:00100000:0.0:1789480352.594006:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526882176 00000100:00100000:0.0:1789480352.594089:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1789480352.594101:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+29:17504:x1876405526882176:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.594150:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480352.594178:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f38a1 expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.594259:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 30 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.594276:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 30 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.594345:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:0.0:1789480352.594349:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480352.594354:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185229000, rc 0) 00000100:00100000:0.0:1789480352.594434:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+30:17504:x1876405526882176:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 335us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480352.594443:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1789480352.609238:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.617717:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526882304 00000100:00100000:1.0:1789480352.617758:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526882304 00000100:00100000:1.0:1789480352.618509:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480352.618552:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2348:x1876405526882304:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789480352.619448:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2348:x1876405526882304:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 899us (10218us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789480352.619460:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00080000:2.0:1789480352.619654:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480352.628065:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.628207:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526882560 00000100:00100000:1.0:1789480352.628221:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526882560 00000100:00100000:1.0:1789480352.628332:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789480352.628345:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+30:17504:x1876405526882560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789480352.628722:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+31:17504:x1876405526882560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 378us (672us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1789480352.628731:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480352.647389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.650158:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526882816 00000100:00100000:1.0:1789480352.650178:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526882816 00000100:00100000:2.0:1789480352.650671:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1789480352.650689:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+31:17504:x1876405526882816:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789480352.651078:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+31:17504:x1876405526882816:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 393us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480352.651088:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1789480352.657863:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.657972:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526882944 00000100:00100000:3.0:1789480352.657998:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526882944 00000100:00100000:3.0:1789480352.658115:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1789480352.658128:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+31:17504:x1876405526882944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480352.658157:0:18866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480352.658184:0:18866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff2de lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f38a8 expref: -99 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.658274:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff2e5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.658655:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff2e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.658675:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff2e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480352.658747:0:18866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480352.658775:0:18866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff2e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.658813:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037ff2de lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a8 expref: 33 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.658835:0:18866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff2e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a8 expref: 32 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.658844:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:3.0:1789480352.658847:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480352.658851:0:18866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480352.658940:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+32:17504:x1876405526882944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 814us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.658961:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1789480352.665010:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480352.665059:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526883072 00000100:00100000:2.0:1789480352.665071:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526883072 00000100:00100000:2.0:1789480352.665142:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1789480352.665154:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+6:2347:x1876405526883072:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480352.665179:0:19551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480352.665223:0:19551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f38af expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480352.665258:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94da0, blocks: 0x1 00010000:00010000:2.0:1789480352.665306:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=645s v=(0 0) 00010000:00010000:2.0:1789480352.665311:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480352.665322:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 7 pid: 19551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.665345:0:19551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 7 pid: 19551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.665362:0:19551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff200, rc 0) 00000100:00100000:2.0:1789480352.665448:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2347:x1876405526883072:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 296us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480352.665456:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1789480352.671930:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.672123:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526883328 00000100:00100000:1.0:1789480352.672141:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526883328 00000100:00100000:1.0:1789480352.672226:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789480352.672240:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+32:17504:x1876405526883328:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480352.672774:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+32:17504:x1876405526883328:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 534us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480352.672785:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1789480352.678067:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.678189:0:20746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526883456 00000100:00100000:3.0:1789480352.678204:0:20746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526883456 00000100:00100000:3.0:1789480352.679857:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:3.0:1789480352.679886:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+32:17504:x1876405526883456:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789480352.812441:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901917 is committed 00000004:00080000:0.0:1789480352.812454:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789480352.812489:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000100:00100000:1.0:1789480352.812938:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+32:17504:x1876405526883456:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 132443us (134335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480352.812957:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1789480352.816934:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552035328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789480352.817035:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480352.817472:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552035328 00000100:00100000:3.0:1789480352.817484:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552035328 00000100:00100000:3.0:1789480352.817568:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480352.817579:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552035328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789480352.817861:0:19955:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789480352.817866:0:19955:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789480352.817878:0:19955:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789480352.817880:0:19955:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1789480352 -> 1789480352 00000100:00080000:2.0:1789480352.817880:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1789480352.817883:0:19955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789480352.817950:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876405552035328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 372us (916us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1789480352.817959:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789480352.818107:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22aea9bb80/2, rc 0, transno 12884901891 00000100:00100000:1.0:1789480352.818116:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552035328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789480352.822484:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480352.822914:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526883584 00000100:00100000:2.0:1789480352.822928:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526883584 00000100:00100000:2.0:1789480352.823016:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789480352.823029:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2348:x1876405526883584:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789480352.823188:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2348:x1876405526883584:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 161us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480352.823196:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789480352.827527:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.827751:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526883840 00000100:00100000:0.0:1789480352.827763:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526883840 00000100:00100000:0.0:1789480352.827852:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1789480352.827864:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+13:17504:x1876405526883840:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.827934:0:18868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480352.827969:0:18868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037ff2e5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a8 expref: 13 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.828022:0:18868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:0.0:1789480352.828028:0:18868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480352.828069:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.828088:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.828100:0:18868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480352.828739:0:18868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bf9a5e7 reply state 000000002c83ff5f transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.828752:0:18868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480352.828891:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+14:17504:x1876405526883840:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1027us (1377us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1789480352.828901:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00010000:00010000:2.0:1789480352.830220:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.830238:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.830245:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.830252:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480352.830257:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.830265:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.830320:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:2.0:1789480352.830324:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480352.830589:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.830599:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229400/0xbb972366037ff2f3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480352.835840:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.837529:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526883968 00000100:00100000:0.0:1789480352.837551:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526883968 00000100:00100000:0.0:1789480352.837645:0:19554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789480352.837658:0:19554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:17504:x1876405526883968:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.839856:0:19554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480352.839900:0:19554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f38b6 expref: -99 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.839963:0:19554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.840001:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480352.840006:0:19554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480352.840012:0:19554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 8 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.840062:0:19554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.840085:0:19554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.840103:0:19554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19554:1876405552035456:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480352.840223:0:19554:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480352.842924:0:19554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19554:1876405552035456:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480352.842976:0:19554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 8 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.843002:0:19554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2185228600, rc 0) 00000100:00100000:0.0:1789480352.843076:0:19554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:17504:x1876405526883968:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5420us (7249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480352.843088:0:19554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789480352.852275:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.856621:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884096 00000100:00100000:1.0:1789480352.856644:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884096 00010000:00010000:0.0:1789480352.861814:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.861998:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480352.862016:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2348:x1876405526884096:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480352.862041:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480352.862081:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.862102:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.862135:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dc0138b/0xbb972366037ff2ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38af expref: 8 pid: 19551 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.862160:0:18851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480352.862165:0:18851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480352.862173:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 7 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.862187:0:18851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 7 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.862245:0:18851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 7 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.862323:0:18851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:18851:1876405552035584:192.168.204.54@tcp:105: 00000100:00100000:0.0:1789480352.863644:0:18851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480352.867031:0:18851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:18851:1876405552035584:192.168.204.54@tcp:105: 00010000:00010000:0.0:1789480352.867071:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480352.867156:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2348:x1876405526884096:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5145us (14896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480352.867170:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1789480352.876819:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.877350:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884224 00000100:00100000:0.0:1789480352.877365:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884224 00000100:00100000:0.0:1789480352.877512:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789480352.877525:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2348:x1876405526884224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789480352.877827:0:19551:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789480352.877832:0:19551:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1789480352 00002000:00010000:0.0:1789480352.877836:0:19551:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1789480350 00002000:00010000:0.0:1789480352.877839:0:19551:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1789480352 -> 1789480352 00002000:00010000:0.0:1789480352.877841:0:19551:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789480352.877937:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2348:x1876405526884224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 413us (1134us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789480352.877946:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789480352.885626:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.885807:0:19955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884352 00000100:00100000:3.0:1789480352.885822:0:19955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884352 00000100:00100000:3.0:1789480352.885901:0:19955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480352.885914:0:19955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2347:x1876405526884352:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789480352.886173:0:19955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.886202:0:19955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 8 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.886212:0:19955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480352.886217:0:19955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480352.886221:0:19955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.886266:0:19955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 8 pid: 19554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.886341:0:19955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 8 pid: 19554 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480352.886388:0:19955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19955:1876405552035712:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480352.886509:0:19955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abcf29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480352.891967:0:19955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19955:1876405552035712:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480352.892017:0:19955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480352.892255:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.893539:0:18853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884480 00000100:00100000:3.0:1789480352.893555:0:18853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884480 00010000:00010000:3.0:1789480352.893624:0:18853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 9 pid: 19554 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480352.893692:0:18853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789480352.893705:0:18853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+9:2347:x1876405526884480:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480352.893727:0:18853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480352.893761:0:18853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 9 pid: 19554 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.893780:0:18853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 9 pid: 19554 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.893812:0:18853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b5efb2/0xbb972366037ff2fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38b6 expref: 9 pid: 19554 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.893865:0:18853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480352.893871:0:18853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480352.893879:0:18853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.893891:0:18853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.893932:0:18853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480352.894019:0:18853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2347:x1876405526884480:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 316us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.894028:0:18853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:2.0:1789480352.895116:0:19955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895135:0:19955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895189:0:19955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895197:0:19955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895206:0:19955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895213:0:19955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480352.895218:0:19955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895228:0:19955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895249:0:19955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.895258:0:19955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcfde25/0xbb972366037ff301 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480352.895418:0:19955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2347:x1876405526884352:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 9493us (9796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480352.895438:0:19955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789480352.904021:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480352.904126:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884736 00000100:00100000:0.0:1789480352.904141:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884736 00000100:00100000:0.0:1789480352.904226:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1789480352.904239:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+13:17504:x1876405526884736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789480352.904637:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.904661:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.904900:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.905226:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.905242:0:18866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 14 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.905251:0:18866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.906484:0:18866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 14 pid: 18866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.906516:0:18866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 14 pid: 18866 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.906536:0:18866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552035840:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480352.906668:0:18866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480352.912021:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.912147:0:18866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552035840:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480352.912187:0:18866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480352.912275:0:18851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884864 00000100:00100000:1.0:1789480352.912335:0:18851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884864 00010000:00010000:1.0:1789480352.912382:0:18851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 15 pid: 18866 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480352.912429:0:18851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789480352.912439:0:18851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187370c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+15:2348:x1876405526884864:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480352.912458:0:18851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480352.912465:0:18851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 15 pid: 18866 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.912483:0:18851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 15 pid: 18866 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.912511:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229000/0xbb972366037ff2d7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38a1 expref: 15 pid: 18866 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.912530:0:18851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:1.0:1789480352.912536:0:18851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.912549:0:18851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.912574:0:18851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.912599:0:18851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480352.912674:0:18851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187370c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+14:2348:x1876405526884864:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 227us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480352.912682:0:18851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00010000:00010000:0.0:1789480352.914819:0:18866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480352.914871:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480352.915146:0:18866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1789480352.916628:0:18866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1789480352.917647:0:18866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1789480352.917806:0:18866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18866:1876405552035968:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789480352.918077:0:18866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480352.918230:0:18866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480352.919761:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552035968 00000100:00100000:2.0:1789480352.919775:0:18871:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552035968 00000100:00100000:2.0:1789480352.919891:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480352.919903:0:18871:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18866:x1876405552035968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789480352.920037:0:18871:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18866:x1876405552035968:12345-0@lo:1000:mdt00_000.0 Request processed in 136us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480352.920044:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480352.920261:0:18866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18866:1876405552035968:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789480352.922184:0:18866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1789480352.922641:0:18866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18866:1876405552036096:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789480352.923437:0:18866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480352.923492:0:18866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22916190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480352.923525:0:18872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036096 00000100:00100000:0.0:1789480352.923540:0:18872:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036096 00000100:00100000:0.0:1789480352.923599:0:18872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480352.923609:0:18872:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18866:x1876405552036096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789480352.923869:0:18872:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18866:x1876405552036096:12345-0@lo:1000:mdt00_000.0 Request processed in 261us (437us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789480352.923877:0:18872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480352.924507:0:18866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18866:1876405552036096:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789480352.924575:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.924590:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.924599:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.924606:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185229c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480352.924612:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.924768:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.924828:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:1.0:1789480352.924831:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480352.924999:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925013:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185229c00/0xbb972366037ff30f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925084:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925091:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925097:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925106:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480352.925109:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925119:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925128:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:1.0:1789480352.925130:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480352.925143:0:18866:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 17 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925159:0:18866:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 17 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.925186:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 17 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.926573:0:18866:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037ff26e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3885 expref: 17 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480352.926600:0:18866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552036224:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480352.934365:0:18866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291619240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480352.938117:0:18866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18866:1876405552036224:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480352.938170:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938184:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037ff267 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938233:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938251:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938265:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938439:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938448:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938475:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938482:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39dc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480352.938486:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938495:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938510:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:1.0:1789480352.938514:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480352.938519:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938527:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037ff316 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938538:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938545:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938550:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938555:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2185228600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480352.938559:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938575:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938584:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:1.0:1789480352.938588:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789480352.938591:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.938597:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2185228600/0xbb972366037ff308 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480352.941535:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17504:x1876405526884736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 37279us (37510us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1789480352.941556:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000020:00080000:0.0:1789480352.941565:0:18866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789480352.942558:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480352.944894:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526884992 00000100:00100000:1.0:1789480352.944918:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526884992 00000100:00100000:1.0:1789480352.945009:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789480352.945024:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17503:x1876405526884992:12345-192.168.204.54@tcp:49:bash.0 00000100:00100000:1.0:1789480352.945220:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17503:x1876405526884992:12345-192.168.204.54@tcp:49:bash.0 Request processed in 199us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480352.945228:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1789480352.948777:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000040:00080000:2.0:1789480352.949209:0:18900:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789480352.949217:0:18900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480352.949273:0:18900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789480352.949298:0:18900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789480352.949696:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526885248 00000100:00100000:1.0:1789480352.949711:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526885248 00000100:00100000:1.0:1789480352.949780:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480352.949793:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+17:17504:x1876405526885248:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789480352.951194:0:18869:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789480352.955106:0:18869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1789480352.955222:0:18869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.955248:0:18869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.955300:0:18869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.955324:0:18869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.955331:0:18869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.955337:0:18869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480352.955368:0:18869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789480352.955521:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:17504:x1876405526885248:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 5724us (6753us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1789480352.955533:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000020:00080000:1.0:1789480352.955542:0:18869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480352.961871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789480352.962207:0:18854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480352.962219:0:18854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.962233:0:18854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480352.962238:0:18854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.962250:0:18854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.962273:0:18854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2290d74000) 00010000:00010000:2.0:1789480352.962277:0:18854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789480352.962325:0:18854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.962357:0:18854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037ff31d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480352.962375:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480352.962377:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480352.962379:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480352.965340:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526885376 00000100:00100000:3.0:1789480352.965357:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526885376 00000100:00100000:3.0:1789480352.965442:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480352.965469:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:17503:x1876405526885376:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480352.965488:0:19553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480352.965511:0:19553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7223d2/0xbb972366037ff324 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f38bd expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480352.965561:0:19553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x6aa94da0, atime: 0x6aa94d9e, ctime: 0x6aa94da0, blocks: 0x1 00010000:00010000:3.0:1789480352.965584:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1789480352.965588:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480352.965598:0:19553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7223d2/0xbb972366037ff324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38bd expref: 8 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.965614:0:19553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e7223d2/0xbb972366037ff324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38bd expref: 8 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480352.965628:0:19553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5200, rc 0) 00000100:00100000:3.0:1789480352.965698:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:17503:x1876405526885376:12345-192.168.204.54@tcp:101:bash.0 Request processed in 246us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480352.965705:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1789480352.974115:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480352.977836:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526885632 00000100:00100000:3.0:1789480352.977862:0:18870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526885632 00000100:00100000:3.0:1789480352.977969:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480352.977984:0:18870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+19:17503:x1876405526885632:12345-192.168.204.54@tcp:35:bash.0 00000001:00080000:3.0:1789480352.978875:0:18870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1789480352.979003:0:18870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1789480352.979227:0:18870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+22:17503:x1876405526885632:12345-192.168.204.54@tcp:35:bash.0 Request processed in 1241us (5122us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1789480352.979238:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000020:00080000:3.0:1789480352.979244:0:18870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789480353.050683:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480353.138269:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138386:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138426:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138521:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138568:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.138606:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526885760 00000100:00100000:2.0:1789480353.138620:0:18860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526885760 00000100:00100000:2.0:1789480353.138686:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1789480353.138700:0:18860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:2347:x1876405526885760:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480353.138797:0:18860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cd89dd-ad1d-496d-8cbb-a8af99c47bc5+13:2347:x1876405526885760:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480353.138805:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1789480353.139029:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526885888 00000100:00100000:1.0:1789480353.139035:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526885888 00000100:00100000:1.0:1789480353.139078:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886272 00000100:00100000:1.0:1789480353.139082:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886272 00000100:00100000:1.0:1789480353.139118:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789480353.139127:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+22:2347:x1876405526885888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480353.139171:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+22:2347:x1876405526885888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 45us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480353.139179:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789480353.139215:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1789480353.139222:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2347:x1876405526886272:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480353.139253:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+6:2347:x1876405526886272:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480353.139260:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00080000:1.0:1789480353.139279:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480353.139837:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886144 00000100:00100000:3.0:1789480353.139844:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886144 00000100:00100000:3.0:1789480353.139882:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886400 00000100:00100000:3.0:1789480353.139887:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886400 00000100:00100000:3.0:1789480353.139920:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886016 00000100:00100000:3.0:1789480353.139923:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886016 00000100:00100000:3.0:1789480353.139936:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886528 00000100:00100000:3.0:1789480353.139939:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886528 00000100:00100000:3.0:1789480353.139957:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480353.139965:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2347:x1876405526886144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480353.140021:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2347:x1876405526886144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 56us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480353.140028:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480353.140046:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789480353.140051:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2347:x1876405526886400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480353.140074:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2347:x1876405526886400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480353.140079:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789480353.140091:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480353.140096:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2347:x1876405526886016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480353.140118:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+5:2347:x1876405526886016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480353.140124:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480353.140137:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789480353.140143:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2347:x1876405526886528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480353.140163:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d3d6d55-1b4d-481a-820a-bd754766c9b2+5:2347:x1876405526886528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480353.140178:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00080000:1.0:1789480353.141142:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480353.141149:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480353.165960:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480353.166089:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886784 00000100:00100000:1.0:1789480353.166103:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886784 00000100:00100000:1.0:1789480353.166186:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1789480353.166201:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+22:17514:x1876405526886784:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480353.166230:0:18867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480353.166257:0:18867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f38c4 expref: -99 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480353.166602:0:18867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789480353.169029:0:18867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff32b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38c4 expref: 24 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480353.169058:0:18867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:1.0:1789480353.169062:0:18867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480353.169069:0:18867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037ff32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f38c4 expref: 24 pid: 18867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480353.169089:0:18867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c000, rc 0) 00000100:00100000:1.0:1789480353.169188:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17514:x1876405526886784:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2989us (3243us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1789480353.169218:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1789480353.178679:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480353.179209:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526886912 00000100:00100000:2.0:1789480353.179227:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526886912 00000100:00100000:2.0:1789480353.179356:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:2.0:1789480353.179377:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17514:x1876405526886912:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1789480353.179499:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179540:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179555:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179573:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179580:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179585:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179883:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179892:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179900:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480353.179954:0:18866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.179970:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181497:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181550:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181559:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480353.181565:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181577:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181598:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d228868fd00) 00010000:00010000:2.0:1789480353.181602:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480353.181609:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181617:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037ff339 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181642:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181649:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.181655:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182803:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480353.182811:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182849:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182868:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d2290ce3c00) 00010000:00010000:2.0:1789480353.182871:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480353.182877:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182885:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037ff340 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182922:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182934:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182942:0:18866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182950:0:18866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480353.182953:0:18866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182960:0:18866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.182970:0:18866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22837b7200) 00010000:00010000:2.0:1789480353.182972:0:18866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480353.182976:0:18866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480353.185229:0:18866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037ff347 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480353.187055:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17514:x1876405526886912:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 7676us (8373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480353.187073:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1789480353.195675:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480353.195802:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526887168 00000100:00100000:1.0:1789480353.195821:0:18869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526887168 00000100:00100000:1.0:1789480353.195915:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1789480353.195928:0:18869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+23:17514:x1876405526887168:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789480353.199791:0:18869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+24:17514:x1876405526887168:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 3844us (4104us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1789480353.199813:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:3.0:1789480354.077917:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480354.138868:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552036352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480354.138961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480354.139939:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036352 00000100:00100000:3.0:1789480354.139954:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036352 00000100:00100000:3.0:1789480354.140050:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480354.140062:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552036352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480354.140113:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480354.140199:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552036352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480354.140207:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789480354.140326:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480354.140390:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552036352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480354.141614:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552036480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480354.141702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480354.142911:0:19555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036480 00000100:00100000:0.0:1789480354.142925:0:19555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036480 00000100:00100000:0.0:1789480354.143036:0:19555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789480354.143053:0:19555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405552036480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480354.143102:0:19555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480354.143404:0:19555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405552036480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 357us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480354.143430:0:19555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789480354.143498:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552036480:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789480354.144817:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480354.146848:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552036608:0@lo:400:kworker.0 00000100:00100000:2.0:1789480354.146978:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480354.147142:0:18861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036608 00000100:00100000:3.0:1789480354.147154:0:18861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036608 00000100:00100000:3.0:1789480354.147244:0:18861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789480354.147257:0:18861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2186a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3300:x1876405552036608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480354.149073:0:18861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2186a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2016df8a-d509-4535-998f-23fecb5de199+19:3300:x1876405552036608:12345-0@lo:400:kworker.0 Request processed in 1804us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480354.149092:0:18861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789480354.150750:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405552036992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480354.151100:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552036736:0@lo:400:kworker.0 00000100:00100000:0.0:1789480354.151799:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480354.151992:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552036864:0@lo:400:kworker.0 00000100:00100000:2.0:1789480354.152257:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2016df8a-d509-4535-998f-23fecb5de199:3300:1876405552036608:0@lo:400:kworker.0 00000100:00100000:3.0:1789480354.152321:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480354.152355:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036736 00000100:00100000:2.0:1789480354.152363:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036736 00000100:00100000:3.0:1789480354.152419:0:18868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036864 00000100:00100000:3.0:1789480354.152424:0:18868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036864 00000100:00100000:3.0:1789480354.152498:0:18868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789480354.152509:0:18868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552036864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480354.152580:0:18868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405552036864:12345-0@lo:400:kworker.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00080000:0.0:1789480354.152892:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480354.152950:0:18868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789480354.152998:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405552036864:0@lo:400:kworker.0 00000100:00100000:1.0:1789480354.153686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480354.158261:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552036992 00000100:00100000:2.0:1789480354.158302:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552036992 00000100:00080000:1.0:1789480354.158444:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480354.158464:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789480354.158479:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552036736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480354.158720:0:20746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789480354.158735:0:20746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405552036992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480354.158962:0:20746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405552036992:12345-0@lo:400:kworker.0 Request processed in 233us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480354.158973:0:20746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789480354.159427:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405552036736:12345-0@lo:400:kworker.0 Request processed in 951us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480354.159436:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480354.159471:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405552036992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480354.159550:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405552036736:0@lo:400:kworker.0 00000001:00080000:2.0:1789480354.677894:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00000001:00080000:2.0:1789480354.677917:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00010000:00010000:2.0:1789480355.099083:0:18854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480355.403149:0:21040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1789480355.708182:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480355.708337:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480355.708373:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526887424 00000100:00100000:0.0:1789480355.708389:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526887424 00000100:00100000:1.0:1789480355.708440:0:19557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526887296 00000100:00100000:1.0:1789480355.708446:0:19557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526887296 00000100:00100000:0.0:1789480355.708554:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480355.708565:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2346:x1876405526887424:12345-192.168.204.54@tcp:16:kworker.0 00002000:00100000:1.0:1789480355.708592:0:19557:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x42:0x0] (0->8) req@ffff8d22a4974380 x1876405526887296/t0(0) o4->1263c5af-228e-4a90-85e8-997aefc2ec3b@192.168.204.54@tcp:506/0 lens 504/0 e 0 to 0 dl 1789480366 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789480355.708603:0:19557:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22a4974380 with x1876405526887296 ext(0->8) 00002000:00010000:1.0:1789480355.708610:0:19557:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22a4974380 00000100:00100000:1.0:1789480355.708627:0:19557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789480355.708632:0:19557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2345:x1876405526887296:12345-192.168.204.54@tcp:4:bash.0 00000100:00100000:0.0:1789480355.708703:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1263c5af-228e-4a90-85e8-997aefc2ec3b+7:2346:x1876405526887424:12345-192.168.204.54@tcp:16:kworker.0 Request processed in 140us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480355.708712:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:2.0:1789480355.709018:0:18862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480355.709162:0:19557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1263c5af-228e-4a90-85e8-997aefc2ec3b+8:2345:x1876405526887296:12345-192.168.204.54@tcp:4:bash.0 Request processed in 528us (880us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789480355.709170:0:19557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:1.0:1789480355.709176:0:19557:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x42:0x0] (0->8) req@ffff8d22a4974380 x1876405526887296/t12884901894(0) o4->1263c5af-228e-4a90-85e8-997aefc2ec3b@192.168.204.54@tcp:506/0 lens 504/448 e 0 to 0 dl 1789480366 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789480355.710309:0:19557:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22a4974380 with x1876405526887296 ext(0->8) 00002000:00010000:1.0:1789480355.710315:0:19557:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22a4974380 00010000:00010000:1.0:1789480356.122869:0:18855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480357.147604:0:19959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 10008 lines, 10008 kept, 0 dropped, 0 bad.